Apr 21 02:21:41 devstack cinder-volume[72786]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 21 02:21:41 devstack cinder-volume[72786]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 21 02:21:41 devstack cinder-volume[72786]: we strongly recommend against using it for new projects.
Apr 21 02:21:41 devstack cinder-volume[72786]: If you are already using Eventlet, we recommend migrating to a different
Apr 21 02:21:41 devstack cinder-volume[72786]: framework.  For more detail see
Apr 21 02:21:41 devstack cinder-volume[72786]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 21 02:21:41 devstack cinder-volume[72786]:   import eventlet  # noqa
Apr 21 02:21:43 devstack cinder-volume[72786]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 21 02:21:43 devstack cinder-volume[72786]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 21 02:21:43 devstack cinder-volume[72786]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 21 02:21:43 devstack cinder-volume[72786]: INFO dbcounter [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Registered counter for database cinder
Apr 21 02:21:43 devstack cinder-volume[72786]: DEBUG oslo_db.sqlalchemy.engines [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:21:43 devstack cinder-volume[72786]: DEBUG dbcounter [-] [72786] Writer thread running {{(pid=72786) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 21 02:21:43 devstack cinder-volume[72786]: INFO cinder.rpc [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 21 02:21:43 devstack cinder-volume[72786]: INFO cinder.rpc [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 21 02:21:43 devstack cinder-volume[72786]: DEBUG oslo_db.sqlalchemy.engines [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:21:43 devstack cinder-volume[72786]: INFO cinder.volume.manager [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Determined volume DB was empty at startup.
Apr 21 02:21:43 devstack cinder-volume[72786]: DEBUG cinder.volume.manager [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72786) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 21 02:21:43 devstack cinder-volume[72786]: INFO cinder.volume.manager [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 21 02:21:43 devstack cinder-volume[72786]: WARNING stevedore.named [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 21 02:21:43 devstack cinder-volume[72786]: WARNING castellan.key_manager [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 21 02:21:43 devstack cinder-volume[72786]: WARNING cinder.keymgr.conf_key_mgr [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 21 02:21:43 devstack cinder-volume[72786]: DEBUG cinder.volume.drivers.lvm [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72786) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Apr 21 02:21:43 devstack cinder-volume[72786]: DEBUG oslo_concurrency.processutils [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72786) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_concurrency.processutils [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] CMD "cinder-rtstool verify" returned: 0 in 0.274s {{(pid=72786) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_db.sqlalchemy.engines [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:21:44 devstack cinder-volume[72786]: INFO cinder.rpc [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Apr 21 02:21:44 devstack cinder-volume[72786]: INFO cinder.rpc [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Apr 21 02:21:44 devstack cinder-volume[72786]: WARNING stevedore.named [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 21 02:21:44 devstack cinder-volume[72786]: WARNING castellan.key_manager [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 21 02:21:44 devstack cinder-volume[72786]: INFO cinder.volume.manager [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_db.sqlalchemy.engines [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72786) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:21:44 devstack cinder-volume[72786]: INFO oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Starting 1 workers
Apr 21 02:21:44 devstack cinder-volume[72890]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Started child 72890 {{(pid=72786) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Full set of CONF: {{(pid=72786) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] ******************************************************************************** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Configuration options gathered from: {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] ================================================================================ {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] allow_availability_zone_fallback = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] allow_compression_on_image_upload = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] allowed_direct_url_schemes     = [] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] api_rate_limit                 = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] auth_strategy                  = keystone {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] az_cache_duration              = 3600 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_availability_zone      = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_host                   = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_name                   = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_stats_polling_interval = 60 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backup_api_class               = cinder.backup.api.API {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backup_name_template           = backup-%s {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backup_use_same_host           = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backup_use_temp_snapshot       = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] chap_password                  = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] chap_username                  =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cinder_internal_tenant_project_id = 4b070d97409b411bbfcb500f3fbe5e06 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cinder_internal_tenant_user_id = 2fe46c858f034982b50975ff553697f0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cloned_volume_same_az          = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cluster                        = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] compression_format             = gzip {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] compute_api_class              = cinder.compute.nova.API {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] config_dir                     = [] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] config_source                  = [] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] control_exchange               = openstack {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] debug                          = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] default_availability_zone      = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] default_group_type             = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] default_volume_type            = lvmdriver-1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] disk_geometry                  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] driver_client_cert             = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] driver_client_cert_key         = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] driver_data_namespace          = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] driver_ssl_cert_path           = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] driver_ssl_cert_verify         = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] driver_use_ssl                 = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] enable_force_upload            = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] enable_new_services            = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] enable_unsupported_driver      = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] enabled_backends               = ['lvmdriver-1'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] enforce_multipath_for_image_xfer = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] filter_function                = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance_api_insecure            = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance_api_servers             = ['http://192.168.122.169/image'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance_api_ssl_compression     = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance_ca_certificates_file    = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance_catalog_info            = image:glance:publicURL {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance_certfile                = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance_keyfile                 = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance_num_retries             = 3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance_request_timeout         = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] goodness_function              = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] graceful_shutdown_timeout      = 5 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] group_api_class                = cinder.group.api.API {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] host                           = devstack {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] image_compress_on_upload       = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] image_conversion_address_space_limit = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] image_conversion_cpu_limit     = 60 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] image_conversion_disable       = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] image_upload_use_cinder_backend = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] image_upload_use_internal_tenant = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] image_volume_cache_enabled     = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] image_volume_cache_max_count   = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] image_volume_cache_max_size_gb = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] init_host_max_objects_retrieval = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] iscsi_target_flags             =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] iscsi_write_cache              = on {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] iser_helper                    = tgtadm {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] iser_ip_address                = 192.168.122.169 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] iser_port                      = 3260 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] log_color                      = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] log_config_append              = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] log_dir                        = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] log_file                       = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] log_options                    = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] log_rotate_interval            = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] log_rotate_interval_type       = days {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] log_rotation_type              = none {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] max_age                        = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] max_logfile_count              = 30 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] max_logfile_size_mb            = 200 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] max_over_subscription_ratio    = 20.0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] message_reap_interval          = 86400 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] message_ttl                    = 2592000 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] migration_create_volume_timeout_secs = 300 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] monkey_patch                   = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] monkey_patch_modules           = [] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] my_ip                          = 192.168.122.169 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] no_snapshot_gb_quota           = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] num_iser_scan_tries            = 3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] num_shell_tries                = 3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] num_volume_device_scan_tries   = 3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] nvmeof_conn_info_version       = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] nvmet_ns_id                    = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] nvmet_port_id                  = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] osapi_max_limit                = 1000 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] osapi_volume_ext_list          = [] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] osapi_volume_listen_port       = 8776 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] osapi_volume_use_ssl           = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] osapi_volume_workers           = 2 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] per_volume_size_limit          = -1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] periodic_fuzzy_delay           = 60 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] periodic_interval              = 60 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] public_endpoint                = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] publish_errors                 = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] quota_backup_gigabytes         = 1000 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] quota_backups                  = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] quota_gigabytes                = 1000 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] quota_groups                   = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] quota_snapshots                = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] quota_volumes                  = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] rate_limit_burst               = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] rate_limit_except_level        = CRITICAL {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] rate_limit_interval            = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] reinit_driver_count            = 3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] replication_device             = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] report_discard_supported       = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] report_interval                = 120 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] reservation_clean_interval     = 86400 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] reservation_expire             = 86400 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] reserved_image_namespaces      = [] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] reserved_percentage            = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] rpc_response_timeout           = 120 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] run_external_periodic_tasks    = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] scst_target_driver             = iscsi {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] scst_target_iqn_name           = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] service_down_time              = 720 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] shell_completion               = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] snapshot_name_template         = snapshot-%s {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] snapshot_same_host             = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] split_loggers                  = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] state_path                     = /opt/stack/data/cinder {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] storage_availability_zone      = nova {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] storage_protocol               = iSCSI {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] syslog_log_facility            = LOG_USER {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] target_helper                  = lioadm {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] target_ip_address              = 192.168.122.169 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] target_port                    = 3260 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] target_protocol                = iscsi {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] target_secondary_ip_addresses  = [] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] trace_flags                    = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] transport_url                  = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] until_refresh                  = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] use_chap_auth                  = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] use_default_quota_class        = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] use_journal                    = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] use_json                       = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] use_multipath_for_image_xfer   = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] use_stderr                     = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] use_syslog                     = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] verify_glance_signatures       = enabled {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_api_class               = cinder.volume.api.API {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_backend_name            = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_clear                   = zero {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_clear_ionice            = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_clear_size              = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_copy_bps_limit          = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_dd_blocksize            = 1M {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_name_template           = volume-%s {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_service_inithost_offload = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volume_usage_audit_period      = month {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] zoning_mode                    = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_concurrency.disable_process_locking = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.admin_password = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.admin_token = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.admin_user  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.auth_admin_prefix =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.auth_port   = 35357 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.auth_protocol = https {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.auth_section = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.auth_type   = password {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.auth_uri    = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.auth_version = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.cache       = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.certfile    = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.identity_uri = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.include_service_catalog = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.insecure    = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.interface   = public {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.keyfile     = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_password =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcache_username =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.region_name = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.service_type = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.169/identity {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.backend                  = dogpile.cache.null {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.backend_argument         = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.backend_expiration_time  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.config_prefix            = cache.oslo {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.debug_cache_backend      = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.enable_retry_client      = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.enable_socket_keepalive  = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.enabled                  = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.enforce_fips_mode        = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.expiration_time          = 600 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.hashclient_retry_attempts = 2 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.memcache_dead_retry      = 300 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.memcache_sasl_enabled    = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.password                 = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.proxies                  = [] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.redis_db                 = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.redis_server             = localhost:6379 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.retry_attempts           = 2 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.retry_delay              = 0.0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.socket_keepalive_count   = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.socket_keepalive_idle    = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.socket_keepalive_interval = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.socket_timeout           = 1.0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.tls_allowed_ciphers      = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.tls_cafile               = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.tls_certfile             = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.tls_enabled              = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.tls_keyfile              = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cache.username                 = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] coordination.backend_url       = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.asyncio_connection    = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.asyncio_slave_connection = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.backend               = sqlalchemy {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.connection            = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.connection_debug      = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.connection_parameters =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.connection_recycle_time = 3600 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.connection_trace      = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.db_inc_retry_interval = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.db_max_retries        = 20 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.db_max_retry_interval = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.db_retry_interval     = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.max_overflow          = 50 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.max_pool_size         = 5 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.max_retries           = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.mysql_wsrep_sync_wait = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.pool_timeout          = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.retry_interval        = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.slave_connection      = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.sqlite_synchronous    = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.synchronous_reader    = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] database.use_db_reconnect      = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler.connection_string     = messaging:// {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler.enabled               = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler.es_doc_type           = notification {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler.es_scroll_size        = 10000 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler.es_scroll_time        = 2m {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler.filter_error_trace    = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler.hmac_keys             = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler.sentinel_service_name = mymaster {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler.socket_timeout        = 0.1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler.trace_requests        = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler.trace_sqlalchemy      = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler_jaeger.process_tags   = {} {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler_jaeger.service_name_prefix = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] profiler_otlp.service_name_prefix = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_policy.enforce_new_defaults = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: WARNING oslo_config.cfg [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_policy.enforce_scope      = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_policy.policy_default_rule = default {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] privsep_osbrick.group          = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] privsep_osbrick.helper_command = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] privsep_osbrick.user           = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cinder_sys_admin.group         = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cinder_sys_admin.helper_command = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] cinder_sys_admin.user          = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] service_user.auth_section      = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] service_user.auth_type         = password {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] service_user.cafile            = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] service_user.certfile          = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] service_user.collect_timing    = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] service_user.insecure          = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] service_user.keyfile           = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] service_user.send_service_user_token = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] service_user.split_loggers     = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] service_user.timeout           = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance.auth_section            = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance.auth_type               = password {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance.certfile                = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance.collect_timing          = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance.insecure                = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance.keyfile                 = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance.region_name             = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance.split_loggers           = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] glance.timeout                 = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.backend_availability_zone = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.chap_password = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.chap_username =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.disk_geometry = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.driver_client_cert = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.driver_client_cert_key = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.driver_data_namespace = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.driver_use_ssl = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.extra_capabilities = {} {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.filter_function = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.goodness_function = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.iscsi_target_flags =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.iscsi_write_cache = on {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.iser_helper   = tgtadm {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.iser_ip_address = 192.168.122.169 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.iser_port     = 3260 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.lvm_mirrors   = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.lvm_share_target = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.lvm_type      = auto {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.num_shell_tries = 3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.replication_device = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.report_discard_supported = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.reserved_percentage = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.target_helper = tgtadm {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.target_ip_address = 192.168.122.169 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.target_port   = 3260 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.target_protocol = iscsi {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.trace_flags   = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.unique_fqdn_network = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.use_chap_auth = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.volume_backend_name = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.volume_clear  = zero {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.volume_clear_ionice = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.volume_clear_size = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.volume_group  = cinder-volumes {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_reports.file_event_handler = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_reports.log_dir           = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.backend_host       = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.chap_password      = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.chap_username      = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.chiscsi_conf       = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.disk_geometry      = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.driver_client_cert = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.driver_use_ssl     = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.extra_capabilities = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.filter_function    = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.goodness_function  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.iser_helper        = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.iser_ip_address    = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.iser_port          = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.lvm_conf_file      = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.lvm_mirrors        = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.lvm_share_target   = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.lvm_type           = auto {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.num_shell_tries    = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.nvmet_port_id      = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.replication_device = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.report_discard_supported = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.reserved_percentage = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.scst_target_driver = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.storage_protocol   = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.target_helper      = lioadm {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.target_ip_address  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.target_port        = 3260 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.target_protocol    = iscsi {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.trace_flags        = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.use_chap_auth      = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.volume_clear       = zero {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.volume_clear_size  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] lvmdriver-1.volumes_dir        = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_notifications.driver = [] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_notifications.retry = -1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72890]: INFO cinder.volume.manager [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Starting volume driver LVMVolumeDriver (3.0.0)
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] key_manager.fixed_key          = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.barbican_api_version  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.barbican_endpoint     = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.barbican_endpoint_type = public {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.barbican_region_name  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.cafile                = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.certfile              = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.collect_timing        = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.insecure              = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.keyfile               = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.number_of_retries     = 60 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.retry_delay           = 1 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.send_service_user_token = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.split_loggers         = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.timeout               = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.verify_ssl            = True {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican.verify_ssl_path       = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican_service_user.auth_section = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican_service_user.auth_type = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican_service_user.cafile   = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican_service_user.certfile = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican_service_user.collect_timing = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican_service_user.insecure = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican_service_user.keyfile  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican_service_user.split_loggers = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] barbican_service_user.timeout  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vault.approle_role_id          = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vault.approle_secret_id        = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vault.kv_mountpoint            = secret {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vault.kv_path                  = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vault.kv_version               = 2 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vault.namespace                = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vault.root_token_id            = **** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vault.ssl_ca_crt_file          = None {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vault.timeout                  = 60.0 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vault.use_ssl                  = False {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:21:44 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] ******************************************************************************** {{(pid=72786) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 21 02:21:44 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:44 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:44 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:44 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:44 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:44 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:44 devstack sudo[72900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Apr 21 02:21:44 devstack sudo[72900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:45 devstack sudo[72900]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:45 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:45 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:45 devstack sudo[73050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 21 02:21:45 devstack sudo[73050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:45 devstack sudo[73050]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:45 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.484s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:45 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:21:45 devstack cinder-volume[72890]: INFO cinder.brick.local_dev.lvm [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Apr 21 02:21:45 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:45 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:45 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:45 devstack sudo[73219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 21 02:21:45 devstack sudo[73219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:46 devstack sudo[73219]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:46 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:46 devstack cinder-volume[72890]: DEBUG cinder.brick.local_dev.lvm [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72890) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}}
Apr 21 02:21:46 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:46 devstack sudo[73413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 21 02:21:46 devstack sudo[73413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:47 devstack sudo[73413]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:47 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.893s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:47 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:47 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:47 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:47 devstack sudo[73585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 21 02:21:47 devstack sudo[73585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:47 devstack sudo[73585]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:47 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.466s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:47 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:47 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:47 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:47 devstack sudo[73589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Apr 21 02:21:47 devstack sudo[73589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:48 devstack sudo[73589]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:48 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.474s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:48 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:48 devstack sudo[73593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 21 02:21:48 devstack sudo[73593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:48 devstack sudo[73593]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:48 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:48 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:48 devstack sudo[73601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 21 02:21:48 devstack sudo[73601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:48 devstack sudo[73601]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:48 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:48 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:48 devstack sudo[73604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 21 02:21:48 devstack sudo[73604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:49 devstack sudo[73604]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:49 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.470s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:49 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:49 devstack sudo[73609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 21 02:21:49 devstack sudo[73609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:49 devstack sudo[73609]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:49 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.455s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:49 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:49 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:49 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:49 devstack sudo[73613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 21 02:21:49 devstack sudo[73613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:50 devstack sudo[73613]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:50 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:50 devstack cinder-volume[72890]: INFO cinder.volume.drivers.lvm [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Enabling LVM thin provisioning by default because a thin pool exists.
Apr 21 02:21:50 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:50 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:50 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:50 devstack sudo[73632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 21 02:21:50 devstack sudo[73632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:50 devstack sudo[73632]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:50 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:50 devstack cinder-volume[72890]: DEBUG cinder.volume.drivers.lvm [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Updating volume stats {{(pid=72890) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 21 02:21:50 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:50 devstack sudo[73745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 21 02:21:50 devstack sudo[73745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:51 devstack sudo[73745]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:51 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.475s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:51 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:51 devstack sudo[73775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 21 02:21:51 devstack sudo[73775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:51 devstack sudo[73775]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:51 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.454s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:51 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:51 devstack sudo[73888]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 21 02:21:51 devstack sudo[73888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:52 devstack sudo[73888]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:52 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.433s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:52 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:52 devstack sudo[73895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 21 02:21:52 devstack sudo[73895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:52 devstack sudo[73895]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:52 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.414s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:52 devstack cinder-volume[72890]: INFO cinder.volume.driver [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Driver hasn't implemented _init_vendor_properties()
Apr 21 02:21:52 devstack cinder-volume[72890]: DEBUG cinder.volume.driver [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72890) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 21 02:21:52 devstack cinder-volume[72890]: DEBUG oslo_db.sqlalchemy.engines [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72890) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:21:52 devstack cinder-volume[72890]: DEBUG dbcounter [-] [72890] Writer thread running {{(pid=72890) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 21 02:21:52 devstack cinder-volume[72890]: DEBUG cinder.db.sqlalchemy.api [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Building query based on filter {{(pid=72890) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 21 02:21:52 devstack cinder-volume[72890]: DEBUG cinder.image.image_utils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72890) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 21 02:21:52 devstack cinder-volume[72890]: INFO cinder.keymgr.migration [None req-416c61b0-f773-4ad9-88fb-3213623e699b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 21 02:21:52 devstack cinder-volume[72890]: DEBUG cinder.volume.drivers.lvm [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Updating volume stats {{(pid=72890) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 21 02:21:52 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:52 devstack sudo[73900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 21 02:21:52 devstack sudo[73900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:53 devstack sudo[73900]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:53 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.497s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:53 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:53 devstack sudo[73903]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 21 02:21:53 devstack sudo[73903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:53 devstack sudo[73903]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:53 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.491s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:53 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:53 devstack sudo[73907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 21 02:21:53 devstack sudo[73907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:54 devstack sudo[73907]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:54 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.463s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:54 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:54 devstack cinder-volume[72786]: DEBUG dbcounter [-] [72786] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72786) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:21:54 devstack sudo[73915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 21 02:21:54 devstack sudo[73915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:54 devstack sudo[73915]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:54 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:54 devstack cinder-volume[72890]: DEBUG cinder.manager [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Notifying Schedulers of capabilities ... {{(pid=72890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:21:54 devstack cinder-volume[72890]: INFO cinder.volume.manager [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Driver initialization completed successfully.
Apr 21 02:21:54 devstack cinder-volume[72890]: INFO cinder.manager [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Initiating service 2 cleanup
Apr 21 02:21:54 devstack cinder-volume[72890]: INFO cinder.manager [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Service 2 cleanup completed.
Apr 21 02:21:54 devstack cinder-volume[72890]: DEBUG cinder.service [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Creating RPC server for service cinder-volume {{(pid=72890) start /opt/stack/cinder/cinder/service.py:231}}
Apr 21 02:21:54 devstack cinder-volume[72890]: DEBUG cinder.service [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72890) start /opt/stack/cinder/cinder/service.py:237}}
Apr 21 02:21:54 devstack cinder-volume[72890]: INFO cinder.volume.manager [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Apr 21 02:21:54 devstack cinder-volume[72890]: DEBUG cinder.volume.drivers.lvm [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Updating volume stats {{(pid=72890) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 21 02:21:54 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:54 devstack sudo[73952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 21 02:21:54 devstack sudo[73952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:55 devstack sudo[73952]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:55 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:55 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:55 devstack sudo[73957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 21 02:21:55 devstack sudo[73957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:55 devstack sudo[73957]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:55 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:55 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:55 devstack sudo[74014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 21 02:21:55 devstack sudo[74014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:56 devstack sudo[74014]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:56 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.443s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:56 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:21:56 devstack sudo[74047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 21 02:21:56 devstack sudo[74047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:21:56 devstack sudo[74047]: pam_unix(sudo:session): session closed for user root
Apr 21 02:21:56 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:21:56 devstack cinder-volume[72890]: INFO cinder.volume.manager [None req-3adb6390-6d0b-445e-a7cc-38639004255d None None] Driver post RPC initialization completed successfully.
Apr 21 02:22:04 devstack cinder-volume[72890]: DEBUG dbcounter [-] [72890] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72890) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:22:06 devstack cinder-volume[72890]: DEBUG dbcounter [-] [72890] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=72890) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:23:28 devstack cinder-volume[72890]: DEBUG oslo_service.periodic_task [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72890) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:23:28 devstack cinder-volume[72890]: DEBUG cinder.volume.drivers.lvm [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Updating volume stats {{(pid=72890) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 21 02:23:28 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:23:28 devstack sudo[79001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 21 02:23:28 devstack sudo[79001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:23:29 devstack sudo[79001]: pam_unix(sudo:session): session closed for user root
Apr 21 02:23:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:23:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:23:29 devstack sudo[79004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 21 02:23:29 devstack sudo[79004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:23:29 devstack sudo[79004]: pam_unix(sudo:session): session closed for user root
Apr 21 02:23:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:23:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:23:29 devstack sudo[79007]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 21 02:23:29 devstack sudo[79007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:23:29 devstack sudo[79007]: pam_unix(sudo:session): session closed for user root
Apr 21 02:23:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.439s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:23:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:23:29 devstack sudo[79014]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 21 02:23:29 devstack sudo[79014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:23:30 devstack sudo[79014]: pam_unix(sudo:session): session closed for user root
Apr 21 02:23:30 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:23:30 devstack cinder-volume[72890]: DEBUG cinder.manager [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Notifying Schedulers of capabilities ... {{(pid=72890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:24:06 devstack cinder-volume[72890]: DEBUG dbcounter [-] [72890] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72890) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:24:28 devstack cinder-volume[72890]: DEBUG oslo_service.periodic_task [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72890) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:24:28 devstack cinder-volume[72890]: DEBUG cinder.volume.drivers.lvm [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Updating volume stats {{(pid=72890) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}}
Apr 21 02:24:28 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:24:28 devstack sudo[80972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Apr 21 02:24:28 devstack sudo[80972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:24:29 devstack sudo[80972]: pam_unix(sudo:session): session closed for user root
Apr 21 02:24:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.428s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:24:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:24:29 devstack sudo[80986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 21 02:24:29 devstack sudo[80986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:24:29 devstack sudo[80986]: pam_unix(sudo:session): session closed for user root
Apr 21 02:24:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:24:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:24:29 devstack sudo[80989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Apr 21 02:24:29 devstack sudo[80989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:24:29 devstack sudo[80989]: pam_unix(sudo:session): session closed for user root
Apr 21 02:24:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.414s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:24:29 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:24:29 devstack sudo[80992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Apr 21 02:24:29 devstack sudo[80992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:24:30 devstack sudo[80992]: pam_unix(sudo:session): session closed for user root
Apr 21 02:24:30 devstack cinder-volume[72890]: DEBUG oslo_concurrency.processutils [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.430s {{(pid=72890) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:24:30 devstack cinder-volume[72890]: DEBUG cinder.manager [None req-2b2d47bb-e107-4146-85dd-81493b9e3b7f None None] Notifying Schedulers of capabilities ... {{(pid=72890) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:25:10 devstack cinder-volume[72786]: INFO oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Caught SIGTERM, stopping children
Apr 21 02:25:10 devstack cinder-volume[72786]: DEBUG oslo_concurrency.lockutils [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Acquiring lock "singleton_lock" {{(pid=72786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 21 02:25:10 devstack cinder-volume[72786]: DEBUG oslo_concurrency.lockutils [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Acquired lock "singleton_lock" {{(pid=72786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 21 02:25:10 devstack cinder-volume[72786]: DEBUG oslo_concurrency.lockutils [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Releasing lock "singleton_lock" {{(pid=72786) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 21 02:25:10 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Stop services. {{(pid=72786) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 21 02:25:10 devstack cinder-volume[72786]: DEBUG oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Killing children. {{(pid=72786) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 21 02:25:10 devstack cinder-volume[72786]: INFO oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Waiting on 1 children to exit
Apr 21 02:25:14 devstack cinder-volume[72890]: DEBUG oslo_concurrency.lockutils [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Acquiring lock "singleton_lock" {{(pid=72890) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 21 02:25:14 devstack cinder-volume[72890]: DEBUG oslo_concurrency.lockutils [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Acquired lock "singleton_lock" {{(pid=72890) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 21 02:25:14 devstack cinder-volume[72890]: DEBUG oslo_concurrency.lockutils [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Releasing lock "singleton_lock" {{(pid=72890) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 21 02:25:14 devstack cinder-volume[72890]: WARNING amqp [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 21 02:25:14 devstack cinder-volume[72890]: WARNING amqp [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 21 02:25:14 devstack cinder-volume[72786]: INFO oslo_service.backend._eventlet.service [None req-4650bd2a-b7bf-4e64-8f46-0323bcfb2c56 None None] Child 72890 exited with status 0
Apr 21 02:25:15 devstack cinder-volume[82206]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 21 02:25:15 devstack cinder-volume[82206]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 21 02:25:15 devstack cinder-volume[82206]: we strongly recommend against using it for new projects.
Apr 21 02:25:15 devstack cinder-volume[82206]: If you are already using Eventlet, we recommend migrating to a different
Apr 21 02:25:15 devstack cinder-volume[82206]: framework.  For more detail see
Apr 21 02:25:15 devstack cinder-volume[82206]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 21 02:25:15 devstack cinder-volume[82206]:   import eventlet  # noqa
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 21 02:25:17 devstack cinder-volume[82206]: INFO dbcounter [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Registered counter for database cinder
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_db.sqlalchemy.engines [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82206) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG dbcounter [-] [82206] Writer thread running {{(pid=82206) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 21 02:25:17 devstack cinder-volume[82206]: INFO cinder.rpc [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 21 02:25:17 devstack cinder-volume[82206]: INFO cinder.rpc [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_db.sqlalchemy.engines [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82206) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:25:17 devstack cinder-volume[82206]: INFO cinder.volume.manager [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Determined volume DB was empty at startup.
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG cinder.volume.manager [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82206) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 21 02:25:17 devstack cinder-volume[82206]: INFO cinder.volume.manager [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Service not found for updating active_backend_id, assuming default for driver init.
Apr 21 02:25:17 devstack cinder-volume[82206]: WARNING stevedore.named [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 21 02:25:17 devstack cinder-volume[82206]: WARNING castellan.key_manager [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 21 02:25:17 devstack cinder-volume[82206]: WARNING cinder.keymgr.conf_key_mgr [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 21 02:25:17 devstack cinder-volume[82206]: INFO cinder.volume.manager [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_db.sqlalchemy.engines [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82206) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:25:17 devstack cinder-volume[82206]: INFO oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Starting 1 workers
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Started child 82323 {{(pid=82206) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Full set of CONF: {{(pid=82206) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] ******************************************************************************** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Configuration options gathered from: {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] ================================================================================ {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] allow_availability_zone_fallback = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] allow_compression_on_image_upload = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] allowed_direct_url_schemes     = [] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] api_rate_limit                 = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] auth_strategy                  = keystone {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_availability_zone      = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_host                   = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_name                   = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_stats_polling_interval = 60 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backup_api_class               = cinder.backup.api.API {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backup_name_template           = backup-%s {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backup_use_same_host           = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backup_use_temp_snapshot       = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] chap_password                  = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] chap_username                  =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cinder_internal_tenant_project_id = 4b070d97409b411bbfcb500f3fbe5e06 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cinder_internal_tenant_user_id = 2fe46c858f034982b50975ff553697f0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cluster                        = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] compression_format             = gzip {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] compute_api_class              = cinder.compute.nova.API {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] config_dir                     = [] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] config_source                  = [] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] control_exchange               = openstack {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] debug                          = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] default_availability_zone      = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] default_group_type             = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] default_volume_type            = QuobyteHD {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] disk_geometry                  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] driver_client_cert             = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] driver_client_cert_key         = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] driver_data_namespace          = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] driver_ssl_cert_path           = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] driver_ssl_cert_verify         = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] driver_use_ssl                 = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] enable_new_services            = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] enable_unsupported_driver      = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] enabled_backends               = ['QuobyteHD'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] enforce_multipath_for_image_xfer = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] filter_function                = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance_api_insecure            = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance_api_servers             = ['http://192.168.122.169/image'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance_api_ssl_compression     = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance_ca_certificates_file    = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance_catalog_info            = image:glance:publicURL {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance_certfile                = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance_keyfile                 = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance_num_retries             = 3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance_request_timeout         = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] goodness_function              = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] graceful_shutdown_timeout      = 5 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] group_api_class                = cinder.group.api.API {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] host                           = devstack {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] image_compress_on_upload       = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] image_conversion_address_space_limit = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] image_conversion_cpu_limit     = 60 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82323]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] image_conversion_disable       = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] image_upload_use_cinder_backend = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] image_upload_use_internal_tenant = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] image_volume_cache_enabled     = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] image_volume_cache_max_count   = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] image_volume_cache_max_size_gb = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] init_host_max_objects_retrieval = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] instance_format                = [instance: %(uuid)s]  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] iscsi_target_flags             =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] iscsi_write_cache              = on {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] iser_helper                    = tgtadm {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] iser_ip_address                = 192.168.122.169 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] iser_port                      = 3260 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] log_color                      = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] log_config_append              = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] log_dir                        = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] log_file                       = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] log_options                    = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] log_rotate_interval            = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] log_rotate_interval_type       = days {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] log_rotation_type              = none {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] max_age                        = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] max_logfile_count              = 30 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] max_logfile_size_mb            = 200 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] max_over_subscription_ratio    = 20.0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] message_reap_interval          = 86400 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] message_ttl                    = 2592000 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] migration_create_volume_timeout_secs = 300 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] monkey_patch                   = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] monkey_patch_modules           = [] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] my_ip                          = 192.168.122.169 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] no_snapshot_gb_quota           = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] num_iser_scan_tries            = 3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] num_shell_tries                = 3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] num_volume_device_scan_tries   = 3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] nvmeof_conn_info_version       = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] nvmet_ns_id                    = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] nvmet_port_id                  = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] osapi_max_limit                = 1000 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] osapi_volume_ext_list          = [] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] osapi_volume_listen_port       = 8776 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] osapi_volume_use_ssl           = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] osapi_volume_workers           = 2 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] per_volume_size_limit          = -1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] periodic_fuzzy_delay           = 60 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] periodic_interval              = 60 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] public_endpoint                = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] publish_errors                 = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] quota_backup_gigabytes         = 1000 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] quota_backups                  = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] quota_gigabytes                = 1000 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] quota_groups                   = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] quota_snapshots                = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] quota_volumes                  = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] rate_limit_burst               = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] rate_limit_except_level        = CRITICAL {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] rate_limit_interval            = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] reinit_driver_count            = 3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] replication_device             = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] report_discard_supported       = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] report_interval                = 120 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] reservation_clean_interval     = 86400 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] reservation_expire             = 86400 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] reserved_image_namespaces      = [] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] reserved_percentage            = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] rpc_response_timeout           = 120 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] run_external_periodic_tasks    = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] scst_target_driver             = iscsi {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] scst_target_iqn_name           = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] service_down_time              = 720 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] shell_completion               = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] snapshot_name_template         = snapshot-%s {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] split_loggers                  = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] state_path                     = /opt/stack/data/cinder {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] storage_availability_zone      = nova {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] storage_protocol               = iSCSI {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] syslog_log_facility            = LOG_USER {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] target_helper                  = lioadm {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] target_ip_address              = 192.168.122.169 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] target_port                    = 3260 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] target_protocol                = iscsi {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] target_secondary_ip_addresses  = [] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] trace_flags                    = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] transport_url                  = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] until_refresh                  = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] use_chap_auth                  = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] use_default_quota_class        = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] use_journal                    = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] use_json                       = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] use_multipath_for_image_xfer   = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] use_stderr                     = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] use_syslog                     = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] verify_glance_signatures       = enabled {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_api_class               = cinder.volume.api.API {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_backend_name            = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_clear                   = zero {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_clear_ionice            = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_clear_size              = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_copy_bps_limit          = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_dd_blocksize            = 1M {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_name_template           = volume-%s {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_service_inithost_offload = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volume_usage_audit_period      = month {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] zoning_mode                    = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_concurrency.disable_process_locking = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.admin_password = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.admin_token = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.admin_user  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.auth_port   = 35357 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.auth_protocol = https {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.auth_section = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.auth_type   = password {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.auth_uri    = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.auth_version = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.cache       = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.certfile    = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.delay_auth_decision = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.http_connect_timeout = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.identity_uri = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.include_service_catalog = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.insecure    = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.interface   = public {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.keyfile     = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_password =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcache_username =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.region_name = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.service_token_roles_required = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.service_type = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.token_cache_time = 300 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.169/identity {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.backend                  = dogpile.cache.null {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.backend_argument         = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.backend_expiration_time  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.config_prefix            = cache.oslo {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.debug_cache_backend      = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.enable_retry_client      = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.enable_socket_keepalive  = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.enabled                  = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.enforce_fips_mode        = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.expiration_time          = 600 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.hashclient_retry_attempts = 2 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.memcache_dead_retry      = 300 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.memcache_pool_maxsize    = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.memcache_sasl_enabled    = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.password                 = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.proxies                  = [] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.redis_db                 = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.redis_sentinel_service_name = mymaster {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.redis_server             = localhost:6379 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.retry_attempts           = 2 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.retry_delay              = 0.0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.socket_keepalive_count   = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.socket_keepalive_idle    = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.socket_keepalive_interval = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.socket_timeout           = 1.0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.tls_allowed_ciphers      = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.tls_cafile               = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.tls_certfile             = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.tls_enabled              = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.tls_keyfile              = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cache.username                 = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] coordination.backend_url       = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.asyncio_connection    = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.asyncio_slave_connection = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.backend               = sqlalchemy {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.connection            = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.connection_debug      = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.connection_parameters =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.connection_recycle_time = 3600 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.connection_trace      = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.db_inc_retry_interval = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.db_max_retries        = 20 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.db_max_retry_interval = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.db_retry_interval     = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.max_overflow          = 50 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.max_pool_size         = 5 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.max_retries           = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.mysql_wsrep_sync_wait = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.pool_timeout          = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.retry_interval        = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.slave_connection      = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.sqlite_synchronous    = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.synchronous_reader    = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] database.use_db_reconnect      = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler.connection_string     = messaging:// {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler.enabled               = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler.es_doc_type           = notification {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler.es_scroll_size        = 10000 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler.es_scroll_time        = 2m {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler.filter_error_trace    = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler.hmac_keys             = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler.sentinel_service_name = mymaster {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler.socket_timeout        = 0.1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler.trace_requests        = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler.trace_sqlalchemy      = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler_jaeger.process_tags   = {} {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler_jaeger.service_name_prefix = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] profiler_otlp.service_name_prefix = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_policy.enforce_new_defaults = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: WARNING oslo_config.cfg [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_policy.enforce_scope      = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_policy.policy_default_rule = default {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_policy.policy_file        = policy.yaml {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] privsep_osbrick.group          = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] privsep_osbrick.helper_command = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] privsep_osbrick.user           = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cinder_sys_admin.group         = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cinder_sys_admin.helper_command = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] cinder_sys_admin.user          = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] service_user.auth_section      = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] service_user.auth_type         = password {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] service_user.cafile            = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] service_user.certfile          = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] service_user.collect_timing    = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] service_user.insecure          = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] service_user.keyfile           = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] service_user.send_service_user_token = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] service_user.split_loggers     = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] service_user.timeout           = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance.auth_section            = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance.auth_type               = password {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance.certfile                = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance.collect_timing          = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance.insecure                = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance.keyfile                 = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance.region_name             = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance.split_loggers           = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] glance.timeout                 = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.backend_availability_zone = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.chap_password = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.chap_username =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.disk_geometry = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.driver_client_cert = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.driver_client_cert_key = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.driver_data_namespace = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.driver_use_ssl = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.enable_unsupported_driver = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.extra_capabilities = {} {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.filter_function = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.goodness_function = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.iscsi_target_flags =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.iscsi_write_cache = on {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.iser_helper   = tgtadm {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.iser_ip_address = 192.168.122.169 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.iser_port     = 3260 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nas_host      =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nas_login     = admin {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nas_mount_options = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nas_password  = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nas_private_key =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nas_share_path =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:17 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.num_shell_tries = 3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.nvmet_port_id = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.quobyte_client_cfg = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.quobyte_volume_url = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.replication_device = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.report_discard_supported = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.reserved_percentage = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.scst_target_driver = iscsi {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.scst_target_iqn_name = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.storage_protocol = iSCSI {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.target_helper = tgtadm {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.target_ip_address = 192.168.122.169 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.target_port   = 3260 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.target_protocol = iscsi {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.trace_flags   = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.unique_fqdn_network = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.use_chap_auth = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.volume_backend_name = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.volume_clear  = zero {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.volume_clear_ionice = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.volume_clear_size = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_reports.file_event_handler = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_reports.log_dir           = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.backend_availability_zone = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.backend_host         = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.chap_password        = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.chap_username        = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.chiscsi_conf         = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.disk_geometry        = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.driver_client_cert   = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.driver_client_cert_key = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.driver_data_namespace = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.driver_use_ssl       = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.extra_capabilities   = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.filter_function      = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.goodness_function    = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.iser_helper          = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.iser_ip_address      = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.iser_port            = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.iser_target_prefix   = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nas_host             = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nas_login            = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nas_mount_options    = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nas_password         = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nas_private_key      = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nas_share_path       = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nas_ssh_port         = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.num_shell_tries      = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.nvmet_port_id        = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.replication_device   = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.report_discard_supported = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.reserved_percentage  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.scst_target_driver   = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.storage_protocol     = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.target_helper        = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.target_ip_address    = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.target_port          = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.target_prefix        = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.target_protocol      = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.trace_flags          = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.use_chap_auth        = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.volume_clear         = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.volume_clear_size    = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] QuobyteHD.volumes_dir          = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.ssl      = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_notifications.driver = [] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_notifications.retry = -1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] oslo_messaging_notifications.transport_url = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] key_manager.fixed_key          = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82323]: INFO cinder.volume.manager [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.barbican_api_version  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.barbican_endpoint     = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.barbican_endpoint_type = public {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.barbican_region_name  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.cafile                = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.certfile              = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.collect_timing        = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.insecure              = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.keyfile               = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.number_of_retries     = 60 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.retry_delay           = 1 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.send_service_user_token = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.split_loggers         = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.timeout               = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.verify_ssl            = True {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican.verify_ssl_path       = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican_service_user.auth_section = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican_service_user.auth_type = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican_service_user.cafile   = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican_service_user.certfile = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican_service_user.collect_timing = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican_service_user.insecure = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican_service_user.keyfile  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican_service_user.split_loggers = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] barbican_service_user.timeout  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vault.approle_role_id          = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vault.approle_secret_id        = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vault.kv_mountpoint            = secret {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vault.kv_path                  = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vault.kv_version               = 2 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vault.namespace                = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vault.root_token_id            = **** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vault.ssl_ca_crt_file          = None {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vault.timeout                  = 60.0 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vault.use_ssl                  = False {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG cinder.volume.drivers.remotefs [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82323) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:18 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] ******************************************************************************** {{(pid=82206) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG cinder.volume.drivers.quobyte [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82323) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 21 02:25:18 devstack cinder-volume[82323]: WARNING cinder.volume.drivers.quobyte [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 21 02:25:18 devstack cinder-volume[82323]: WARNING cinder.volume.drivers.quobyte [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Running cmd (subprocess): mount.quobyte {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:25:18 devstack quobyte-client[82324]: Reading configuration file: /etc/quobyte/client.cfg
Apr 21 02:25:18 devstack quobyte-client[82324]: Invalid parameters found, error: missing mount point.
Apr 21 02:25:18 devstack quobyte-client[82324]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 21 02:25:18 devstack quobyte-client[82324]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] CMD "mount.quobyte" returned: 1 in 0.062s {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG cinder.volume.drivers.quobyte [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82323) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:25:18 devstack cinder-volume[82323]: INFO cinder.volume.drivers.quobyte [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 ...
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 -c /etc/quobyte/client-cinder.cfg {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:25:18 devstack sudo[82325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 -c /etc/quobyte/client-cinder.cfg
Apr 21 02:25:18 devstack sudo[82325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:25:18 devstack sudo[82325]: pam_unix(sudo:session): session closed for user root
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.499s {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:25:18 devstack cinder-volume[82323]: INFO cinder.volume.drivers.quobyte [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 succeeded
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG cinder.volume.drivers.quobyte [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82323) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.506s {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:25:18 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:25:18 devstack sudo[82394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:25:18 devstack sudo[82394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:25:19 devstack sudo[82394]: pam_unix(sudo:session): session closed for user root
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.401s {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:25:19 devstack cinder-volume[82323]: INFO cinder.volume.driver [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Driver hasn't implemented _init_vendor_properties()
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG cinder.volume.driver [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82323) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG oslo_db.sqlalchemy.engines [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82323) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG dbcounter [-] [82323] Writer thread running {{(pid=82323) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG cinder.db.sqlalchemy.api [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Building query based on filter {{(pid=82323) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG cinder.image.image_utils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82323) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 21 02:25:19 devstack cinder-volume[82323]: INFO cinder.keymgr.migration [None req-bd1c1b0d-3f7d-461e-9d91-1a4f9f340a8b None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG cinder.volume.drivers.quobyte [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82323) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG cinder.volume.drivers.quobyte [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82323) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:25:19 devstack sudo[82397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:25:19 devstack sudo[82397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:25:19 devstack sudo[82397]: pam_unix(sudo:session): session closed for user root
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.400s {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG cinder.manager [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Notifying Schedulers of capabilities ... {{(pid=82323) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:25:19 devstack cinder-volume[82323]: INFO cinder.volume.manager [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Driver initialization completed successfully.
Apr 21 02:25:19 devstack cinder-volume[82323]: INFO cinder.manager [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Initiating service 3 cleanup
Apr 21 02:25:19 devstack cinder-volume[82323]: INFO cinder.manager [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Service 3 cleanup completed.
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG cinder.service [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Creating RPC server for service cinder-volume {{(pid=82323) start /opt/stack/cinder/cinder/service.py:231}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG cinder.service [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82323) start /opt/stack/cinder/cinder/service.py:237}}
Apr 21 02:25:19 devstack cinder-volume[82323]: INFO cinder.volume.manager [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG cinder.volume.drivers.quobyte [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82323) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG cinder.volume.drivers.quobyte [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82323) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:25:19 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:25:19 devstack sudo[82403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:25:19 devstack sudo[82403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:25:20 devstack sudo[82403]: pam_unix(sudo:session): session closed for user root
Apr 21 02:25:20 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.416s {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:25:20 devstack cinder-volume[82323]: INFO cinder.volume.manager [None req-14251da9-979f-4a82-853f-d39c74f778fd None None] Driver post RPC initialization completed successfully.
Apr 21 02:25:22 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-7072dbbf-8316-4d72-a1ad-5a8edf8902fa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:25:22 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-7072dbbf-8316-4d72-a1ad-5a8edf8902fa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:25:22 devstack cinder-volume[82323]: DEBUG cinder.volume.drivers.quobyte [None req-7072dbbf-8316-4d72-a1ad-5a8edf8902fa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82323) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:25:22 devstack cinder-volume[82323]: DEBUG cinder.volume.drivers.quobyte [None req-7072dbbf-8316-4d72-a1ad-5a8edf8902fa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82323) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:25:22 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-7072dbbf-8316-4d72-a1ad-5a8edf8902fa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82323) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:25:22 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-7072dbbf-8316-4d72-a1ad-5a8edf8902fa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:25:22 devstack sudo[82470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:25:22 devstack sudo[82470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:25:23 devstack sudo[82470]: pam_unix(sudo:session): session closed for user root
Apr 21 02:25:23 devstack cinder-volume[82323]: DEBUG oslo_concurrency.processutils [None req-7072dbbf-8316-4d72-a1ad-5a8edf8902fa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.405s {{(pid=82323) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:25:23 devstack cinder-volume[82323]: DEBUG cinder.manager [None req-7072dbbf-8316-4d72-a1ad-5a8edf8902fa None None] Notifying Schedulers of capabilities ... {{(pid=82323) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:25:26 devstack cinder-volume[82206]: INFO oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Caught SIGTERM, stopping children
Apr 21 02:25:26 devstack cinder-volume[82206]: DEBUG oslo_concurrency.lockutils [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Acquiring lock "singleton_lock" {{(pid=82206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 21 02:25:26 devstack cinder-volume[82206]: DEBUG oslo_concurrency.lockutils [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Acquired lock "singleton_lock" {{(pid=82206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 21 02:25:26 devstack cinder-volume[82206]: DEBUG oslo_concurrency.lockutils [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Releasing lock "singleton_lock" {{(pid=82206) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 21 02:25:26 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Stop services. {{(pid=82206) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Apr 21 02:25:26 devstack cinder-volume[82206]: DEBUG oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Killing children. {{(pid=82206) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Apr 21 02:25:26 devstack cinder-volume[82206]: INFO oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Waiting on 1 children to exit
Apr 21 02:25:27 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Acquiring lock "singleton_lock" {{(pid=82323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 21 02:25:27 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Acquired lock "singleton_lock" {{(pid=82323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 21 02:25:27 devstack cinder-volume[82323]: DEBUG oslo_concurrency.lockutils [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Releasing lock "singleton_lock" {{(pid=82323) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 21 02:25:27 devstack cinder-volume[82323]: WARNING amqp [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 21 02:25:27 devstack cinder-volume[82323]: WARNING amqp [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Received method (60, 30) during closing channel 1. This method will be ignored
Apr 21 02:25:27 devstack cinder-volume[82206]: INFO oslo_service.backend._eventlet.service [None req-8ba4657c-cd91-47f0-abb9-e95b2a784fcb None None] Child 82323 exited with status 0
Apr 21 02:25:28 devstack cinder-volume[82541]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Apr 21 02:25:28 devstack cinder-volume[82541]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 21 02:25:28 devstack cinder-volume[82541]: we strongly recommend against using it for new projects.
Apr 21 02:25:28 devstack cinder-volume[82541]: If you are already using Eventlet, we recommend migrating to a different
Apr 21 02:25:28 devstack cinder-volume[82541]: framework.  For more detail see
Apr 21 02:25:28 devstack cinder-volume[82541]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 21 02:25:28 devstack cinder-volume[82541]:   import eventlet  # noqa
Apr 21 02:25:29 devstack cinder-volume[82541]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82541) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}}
Apr 21 02:25:29 devstack cinder-volume[82541]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82541) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}}
Apr 21 02:25:29 devstack cinder-volume[82541]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82541) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}}
Apr 21 02:25:30 devstack cinder-volume[82541]: INFO dbcounter [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Registered counter for database cinder
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_db.sqlalchemy.engines [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG dbcounter [-] [82541] Writer thread running {{(pid=82541) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 21 02:25:30 devstack cinder-volume[82541]: INFO cinder.rpc [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Apr 21 02:25:30 devstack cinder-volume[82541]: INFO cinder.rpc [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_db.sqlalchemy.engines [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:25:30 devstack cinder-volume[82541]: INFO cinder.volume.manager [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Determined volume DB was empty at startup.
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG cinder.volume.manager [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82541) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Apr 21 02:25:30 devstack cinder-volume[82541]: WARNING stevedore.named [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Apr 21 02:25:30 devstack cinder-volume[82541]: WARNING castellan.key_manager [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 21 02:25:30 devstack cinder-volume[82541]: WARNING cinder.keymgr.conf_key_mgr [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Apr 21 02:25:30 devstack cinder-volume[82541]: INFO cinder.volume.manager [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Image-volume cache disabled for host devstack@QuobyteHD.
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_db.sqlalchemy.engines [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82541) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:25:30 devstack cinder-volume[82541]: INFO oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Starting 1 workers
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Started child 82686 {{(pid=82541) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Full set of CONF: {{(pid=82541) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] ******************************************************************************** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Configuration options gathered from: {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] ================================================================================ {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] allow_availability_zone_fallback = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] allow_compression_on_image_upload = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] allowed_direct_url_schemes     = [] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] api_rate_limit                 = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] auth_strategy                  = keystone {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_availability_zone      = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_host                   = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_name                   = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_stats_polling_interval = 60 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backup_api_class               = cinder.backup.api.API {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backup_name_template           = backup-%s {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backup_use_same_host           = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backup_use_temp_snapshot       = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] chap_password                  = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] chap_username                  =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cinder_internal_tenant_project_id = 4b070d97409b411bbfcb500f3fbe5e06 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cinder_internal_tenant_user_id = 2fe46c858f034982b50975ff553697f0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cluster                        = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] compression_format             = gzip {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] compute_api_class              = cinder.compute.nova.API {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] config_dir                     = [] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] config_source                  = [] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] control_exchange               = openstack {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82686]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0)
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] debug                          = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] default_availability_zone      = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] default_group_type             = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] default_volume_type            = QuobyteHD {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] disk_geometry                  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] driver_client_cert             = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] driver_client_cert_key         = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] driver_data_namespace          = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] driver_ssl_cert_path           = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] driver_ssl_cert_verify         = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] driver_use_ssl                 = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] enable_new_services            = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] enable_unsupported_driver      = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] enabled_backends               = ['QuobyteHD'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] enforce_multipath_for_image_xfer = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] filter_function                = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance_api_insecure            = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance_api_servers             = ['http://192.168.122.169/image'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance_api_ssl_compression     = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance_ca_certificates_file    = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance_catalog_info            = image:glance:publicURL {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance_certfile                = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance_keyfile                 = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance_num_retries             = 3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance_request_timeout         = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] goodness_function              = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] graceful_shutdown_timeout      = 5 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] group_api_class                = cinder.group.api.API {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] host                           = devstack {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] image_compress_on_upload       = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] image_conversion_address_space_limit = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] image_conversion_cpu_limit     = 60 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] image_conversion_disable       = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] image_upload_use_cinder_backend = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] image_upload_use_internal_tenant = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] image_volume_cache_enabled     = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] image_volume_cache_max_count   = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] image_volume_cache_max_size_gb = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] init_host_max_objects_retrieval = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] instance_format                = [instance: %(uuid)s]  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] iscsi_target_flags             =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] iscsi_write_cache              = on {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] iser_helper                    = tgtadm {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] iser_ip_address                = 192.168.122.169 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] iser_port                      = 3260 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] log_color                      = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] log_config_append              = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] log_dir                        = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] log_file                       = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] log_options                    = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] log_rotate_interval            = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] log_rotate_interval_type       = days {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] log_rotation_type              = none {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] max_age                        = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] max_logfile_count              = 30 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] max_logfile_size_mb            = 200 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] max_over_subscription_ratio    = 20.0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] message_reap_interval          = 86400 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] message_ttl                    = 2592000 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] migration_create_volume_timeout_secs = 300 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] monkey_patch                   = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] monkey_patch_modules           = [] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] my_ip                          = 192.168.122.169 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] no_snapshot_gb_quota           = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] num_iser_scan_tries            = 3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] num_shell_tries                = 3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] num_volume_device_scan_tries   = 3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] nvmeof_conn_info_version       = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] nvmet_ns_id                    = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] nvmet_port_id                  = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] osapi_max_limit                = 1000 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] osapi_volume_ext_list          = [] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] osapi_volume_listen            = 0.0.0.0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] osapi_volume_listen_port       = 8776 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] osapi_volume_use_ssl           = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] osapi_volume_workers           = 2 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] per_volume_size_limit          = -1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] periodic_fuzzy_delay           = 60 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] periodic_interval              = 60 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] project_id_regex               = [0-9a-f\-]+ {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] public_endpoint                = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] publish_errors                 = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] quota_backup_gigabytes         = 1000 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] quota_backups                  = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] quota_gigabytes                = 1000 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] quota_groups                   = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] quota_snapshots                = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] quota_volumes                  = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] rate_limit_burst               = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] rate_limit_except_level        = CRITICAL {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] rate_limit_interval            = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] reinit_driver_count            = 3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] replication_device             = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] report_discard_supported       = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] report_interval                = 120 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] reservation_clean_interval     = 86400 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] reservation_expire             = 86400 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] reserved_image_namespaces      = [] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] reserved_percentage            = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] rpc_response_timeout           = 120 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] run_external_periodic_tasks    = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] scst_target_driver             = iscsi {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] scst_target_iqn_name           = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] service_down_time              = 720 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] shell_completion               = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] snapshot_name_template         = snapshot-%s {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] split_loggers                  = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] state_path                     = /opt/stack/data/cinder {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] storage_availability_zone      = nova {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] storage_protocol               = iSCSI {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] syslog_log_facility            = LOG_USER {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] target_helper                  = lioadm {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] target_ip_address              = 192.168.122.169 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] target_port                    = 3260 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] target_protocol                = iscsi {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] target_secondary_ip_addresses  = [] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] trace_flags                    = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] transfer_api_class             = cinder.transfer.api.API {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] transport_url                  = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] until_refresh                  = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] use_chap_auth                  = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] use_default_quota_class        = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] use_journal                    = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] use_json                       = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] use_multipath_for_image_xfer   = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] use_stderr                     = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] use_syslog                     = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] verify_glance_signatures       = enabled {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_api_class               = cinder.volume.api.API {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_backend_name            = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_clear                   = zero {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_clear_ionice            = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_clear_size              = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Starting volume driver QuobyteDriver (1.1.14)
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_copy_bps_limit          = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82686) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_dd_blocksize            = 1M {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_name_template           = volume-%s {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_service_inithost_offload = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volume_usage_audit_period      = month {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] zoning_mode                    = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_concurrency.disable_process_locking = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.admin_password = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.admin_token = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.admin_user  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.auth_admin_prefix =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.auth_port   = 35357 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.auth_protocol = https {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.auth_section = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.auth_type   = password {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.auth_uri    = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.auth_version = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.cache       = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.certfile    = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.delay_auth_decision = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.http_connect_timeout = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.identity_uri = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.include_service_catalog = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.insecure    = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.interface   = public {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.keyfile     = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_password =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcache_username =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.region_name = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.service_token_roles_required = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.service_type = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.token_cache_time = 300 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.169/identity {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.backend                  = dogpile.cache.null {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.backend_argument         = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.backend_expiration_time  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.config_prefix            = cache.oslo {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.debug_cache_backend      = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.enable_retry_client      = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.enable_socket_keepalive  = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.enabled                  = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.enforce_fips_mode        = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.expiration_time          = 600 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.hashclient_retry_attempts = 2 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.memcache_dead_retry      = 300 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.memcache_pool_maxsize    = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.memcache_sasl_enabled    = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.password                 = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.proxies                  = [] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.redis_db                 = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.redis_sentinel_service_name = mymaster {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.redis_server             = localhost:6379 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.retry_attempts           = 2 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.retry_delay              = 0.0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.socket_keepalive_count   = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.socket_keepalive_idle    = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.socket_keepalive_interval = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.socket_timeout           = 1.0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.tls_allowed_ciphers      = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.tls_cafile               = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.tls_certfile             = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.tls_enabled              = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.tls_keyfile              = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cache.username                 = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] coordination.backend_url       = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.asyncio_connection    = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.asyncio_slave_connection = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.backend               = sqlalchemy {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.connection            = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.connection_debug      = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.connection_parameters =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.connection_recycle_time = 3600 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.connection_trace      = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.db_inc_retry_interval = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.db_max_retries        = 20 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.db_max_retry_interval = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.db_retry_interval     = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.max_overflow          = 50 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.max_pool_size         = 5 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.max_retries           = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.mysql_wsrep_sync_wait = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.pool_timeout          = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.retry_interval        = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.slave_connection      = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.sqlite_synchronous    = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.synchronous_reader    = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] database.use_db_reconnect      = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler.connection_string     = messaging:// {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler.enabled               = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler.es_doc_type           = notification {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler.es_scroll_size        = 10000 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler.es_scroll_time        = 2m {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler.filter_error_trace    = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler.hmac_keys             = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler.sentinel_service_name = mymaster {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler.socket_timeout        = 0.1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler.trace_requests        = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler.trace_sqlalchemy      = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler_jaeger.process_tags   = {} {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler_jaeger.service_name_prefix = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] profiler_otlp.service_name_prefix = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_policy.enforce_new_defaults = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82686) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}}
Apr 21 02:25:30 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.quobyte [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Apr 21 02:25:30 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.quobyte [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Apr 21 02:25:30 devstack cinder-volume[82541]: WARNING oslo_config.cfg [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_policy.enforce_scope      = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Running cmd (subprocess): mount.quobyte {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_policy.policy_default_rule = default {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_policy.policy_file        = policy.yaml {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_policy.remote_timeout     = 60.0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] privsep_osbrick.group          = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] privsep_osbrick.helper_command = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] privsep_osbrick.user           = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cinder_sys_admin.group         = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cinder_sys_admin.helper_command = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] cinder_sys_admin.user          = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] service_user.auth_section      = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] service_user.auth_type         = password {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] service_user.cafile            = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] service_user.certfile          = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] service_user.collect_timing    = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] service_user.insecure          = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] service_user.keyfile           = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] service_user.send_service_user_token = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] service_user.split_loggers     = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] service_user.timeout           = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance.auth_section            = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance.auth_type               = password {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance.certfile                = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance.collect_timing          = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance.insecure                = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance.keyfile                 = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance.region_name             = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance.split_loggers           = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] glance.timeout                 = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.backend_availability_zone = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.chap_password = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.chap_username =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.disk_geometry = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.driver_client_cert = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.driver_client_cert_key = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.driver_data_namespace = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.driver_use_ssl = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.enable_unsupported_driver = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.extra_capabilities = {} {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.filter_function = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.goodness_function = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.iscsi_target_flags =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.iscsi_write_cache = on {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.iser_helper   = tgtadm {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.iser_ip_address = 192.168.122.169 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.iser_port     = 3260 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nas_host      =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nas_login     = admin {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nas_mount_options = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nas_password  = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nas_private_key =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nas_share_path =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nas_ssh_port  = 22 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.num_shell_tries = 3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.nvmet_port_id = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.quobyte_client_cfg = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.quobyte_volume_url = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.replication_device = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.report_discard_supported = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.reserved_percentage = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.scst_target_driver = iscsi {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.scst_target_iqn_name = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.storage_protocol = iSCSI {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.target_helper = tgtadm {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.target_ip_address = 192.168.122.169 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.target_port   = 3260 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.target_protocol = iscsi {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.trace_flags   = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.unique_fqdn_network = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.use_chap_auth = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.volume_backend_name = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.volume_clear  = zero {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.volume_clear_ionice = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.volume_clear_size = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_reports.file_event_handler = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_reports.log_dir           = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.backend_availability_zone = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.backend_host         = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.chap_password        = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.chap_username        = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.chiscsi_conf         = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.disk_geometry        = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.driver_client_cert   = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.driver_client_cert_key = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.driver_data_namespace = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.driver_use_ssl       = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.extra_capabilities   = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.filter_function      = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.goodness_function    = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack quobyte-client[82720]: Reading configuration file: /etc/quobyte/client.cfg
Apr 21 02:25:30 devstack quobyte-client[82720]: Invalid parameters found, error: missing mount point.
Apr 21 02:25:30 devstack quobyte-client[82720]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Apr 21 02:25:30 devstack quobyte-client[82720]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.iscsi_target_flags   = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.iscsi_write_cache    = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.iser_helper          = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.iser_ip_address      = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:30 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.iser_port            = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.iser_target_prefix   = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nas_host             = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nas_login            = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nas_mount_options    = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nas_password         = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nas_private_key      = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nas_share_path       = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nas_ssh_port         = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.num_shell_tries      = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nvmet_ns_id          = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.nvmet_port_id        = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.replication_device   = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.report_discard_supported = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.reserved_percentage  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.scst_target_driver   = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.storage_protocol     = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.target_helper        = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.target_ip_address    = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.target_port          = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.target_prefix        = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.target_protocol      = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.trace_flags          = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.unique_fqdn_network  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.use_chap_auth        = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.volume_clear         = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.volume_clear_ionice  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.volume_clear_size    = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] QuobyteHD.volumes_dir          = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.ssl      = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.ssl_version =  {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack sudo[82721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:25:31 devstack sudo[82721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_notifications.driver = [] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_notifications.retry = -1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] oslo_messaging_notifications.transport_url = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] key_manager.fixed_key          = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.barbican_api_version  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.barbican_endpoint     = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.barbican_endpoint_type = public {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.barbican_region_name  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.cafile                = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.certfile              = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.collect_timing        = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.insecure              = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.keyfile               = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.number_of_retries     = 60 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.retry_delay           = 1 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.send_service_user_token = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.split_loggers         = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.timeout               = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.verify_ssl            = True {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican.verify_ssl_path       = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican_service_user.auth_section = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican_service_user.auth_type = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican_service_user.cafile   = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican_service_user.certfile = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican_service_user.collect_timing = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican_service_user.insecure = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican_service_user.keyfile  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican_service_user.split_loggers = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] barbican_service_user.timeout  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vault.approle_role_id          = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vault.approle_secret_id        = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vault.kv_mountpoint            = secret {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vault.kv_path                  = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vault.kv_version               = 2 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vault.namespace                = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vault.root_token_id            = **** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vault.ssl_ca_crt_file          = None {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vault.timeout                  = 60.0 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vault.use_ssl                  = False {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}}
Apr 21 02:25:31 devstack cinder-volume[82541]: DEBUG oslo_service.backend._eventlet.service [None req-60ea7aae-3fec-4211-bf2a-5b08102ebbbe None None] ******************************************************************************** {{(pid=82541) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}}
Apr 21 02:25:31 devstack sudo[82721]: pam_unix(sudo:session): session closed for user root
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.903s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:25:31 devstack cinder-volume[82686]: INFO cinder.volume.driver [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Driver hasn't implemented _init_vendor_properties()
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG cinder.volume.driver [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82686) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG oslo_db.sqlalchemy.engines [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82686) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writer thread running {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG cinder.db.sqlalchemy.api [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Building query based on filter {{(pid=82686) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82686) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:25:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:25:31 devstack cinder-volume[82686]: INFO cinder.keymgr.migration [None req-8d037565-1aeb-4b80-b06a-3997109669cf None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Apr 21 02:25:32 devstack sudo[82785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:25:32 devstack sudo[82785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:25:32 devstack sudo[82785]: pam_unix(sudo:session): session closed for user root
Apr 21 02:25:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.448s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:25:32 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:25:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Driver initialization completed successfully.
Apr 21 02:25:32 devstack cinder-volume[82686]: INFO cinder.manager [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Initiating service 3 cleanup
Apr 21 02:25:32 devstack cinder-volume[82686]: INFO cinder.manager [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Service 3 cleanup completed.
Apr 21 02:25:32 devstack cinder-volume[82686]: DEBUG cinder.service [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Creating RPC server for service cinder-volume {{(pid=82686) start /opt/stack/cinder/cinder/service.py:231}}
Apr 21 02:25:32 devstack cinder-volume[82686]: DEBUG cinder.service [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82686) start /opt/stack/cinder/cinder/service.py:237}}
Apr 21 02:25:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14)
Apr 21 02:25:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:25:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:25:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:25:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:25:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:25:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:25:32 devstack sudo[82790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:25:32 devstack sudo[82790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:25:32 devstack sudo[82790]: pam_unix(sudo:session): session closed for user root
Apr 21 02:25:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.413s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:25:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-01b9c63c-4063-431c-b9e4-b353be5a3202 None None] Driver post RPC initialization completed successfully.
Apr 21 02:25:40 devstack cinder-volume[82541]: DEBUG dbcounter [-] [82541] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82541) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:25:42 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:25:42 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=3 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:26:33 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:26:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Flow 'volume_create_manager' (ec11bf9a-e78e-44f0-8320-d353ed8aef9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:26:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8067e0-d752-4752-bb65-2358255c6fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8067e0-d752-4752-bb65-2358255c6fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-319948063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f44f891-d904-42c2-980d-26a6ac392611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6bf556cc53e4f998b1ca173013b4adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:26:34Z,use_quota=True,user_id='bd4722ad96374e1f8d0b3c51030be150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52618146-015c-4571-b07f-f3054cbfb3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52618146-015c-4571-b07f-f3054cbfb3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701645bc-2f48-4b94-bd39-2ca774231907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (701645bc-2f48-4b94-bd39-2ca774231907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f44f891-d904-42c2-980d-26a6ac392611', 'volume_name': 'volume-1f44f891-d904-42c2-980d-26a6ac392611', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd29ed4-66fd-464e-a039-a7b7e4d82923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcd29ed4-66fd-464e-a039-a7b7e4d82923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28cae2b-7941-4f6e-9167-602b61ae5666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:34 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Volume 1f44f891-d904-42c2-980d-26a6ac392611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f44f891-d904-42c2-980d-26a6ac392611', 'volume_size': 1}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:26:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-319948063',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f44f891-d904-42c2-980d-26a6ac392611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6bf556cc53e4f998b1ca173013b4adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:26:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:26:34Z,use_quota=True,user_id='bd4722ad96374e1f8d0b3c51030be150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Creating volume 1f44f891-d904-42c2-980d-26a6ac392611 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:26:34 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:26:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:26:34 devstack sudo[83386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611 1073741824
Apr 21 02:26:34 devstack sudo[83386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:26:35 devstack sudo[83386]: pam_unix(sudo:session): session closed for user root
Apr 21 02:26:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611 1073741824" returned: 0 in 1.672s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:26:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:26:35 devstack sudo[83705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611
Apr 21 02:26:35 devstack sudo[83705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:26:36 devstack sudo[83705]: pam_unix(sudo:session): session closed for user root
Apr 21 02:26:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611" returned: 0 in 0.816s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:26:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] <== create_volume: return (2589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:26:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.591s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:26:36 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28cae2b-7941-4f6e-9167-602b61ae5666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f44f891-d904-42c2-980d-26a6ac392611', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:36 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9a9e5c-c094-47ab-becd-df31ddabc6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:36 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Volume volume-1f44f891-d904-42c2-980d-26a6ac392611 (1f44f891-d904-42c2-980d-26a6ac392611): created successfully
Apr 21 02:26:36 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a9a9e5c-c094-47ab-becd-df31ddabc6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:36 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Flow 'volume_create_manager' (ec11bf9a-e78e-44f0-8320-d353ed8aef9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:26:36 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f02e2c2a-cf62-48ec-a69c-8fc94b3150a3 tempest-DeleteServersTestJSON-1690048183 None] Created volume successfully.
Apr 21 02:26:44 devstack cinder-volume[82686]: WARNING py.warnings [req-5bb7f9df-f618-4832-8b29-c7f9f55033a0 req-a7f53a4f-18ee-4349-aa83-56edf4afd8c9 tempest-DeleteServersTestJSON-1690048183 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment".  Apply join condition(s) between each element to resolve.
Apr 21 02:26:44 devstack cinder-volume[82686]:   .first()
Apr 21 02:26:44 devstack cinder-volume[82686]: 
Apr 21 02:26:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-5bb7f9df-f618-4832-8b29-c7f9f55033a0 req-a7f53a4f-18ee-4349-aa83-56edf4afd8c9 tempest-DeleteServersTestJSON-1690048183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:26:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-5bb7f9df-f618-4832-8b29-c7f9f55033a0 req-a7f53a4f-18ee-4349-aa83-56edf4afd8c9 tempest-DeleteServersTestJSON-1690048183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:26:44 devstack cinder-volume[82686]: INFO oslo.privsep.daemon [req-5bb7f9df-f618-4832-8b29-c7f9f55033a0 req-a7f53a4f-18ee-4349-aa83-56edf4afd8c9 tempest-DeleteServersTestJSON-1690048183 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpw16obgrn/privsep.sock']
Apr 21 02:26:44 devstack sudo[83774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpw16obgrn/privsep.sock
Apr 21 02:26:44 devstack sudo[83774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:26:44 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:26:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Flow 'volume_create_manager' (80f4e6ed-f79b-4624-855c-97b3f3c57e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:26:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ed2a05-db4e-45a3-9c4b-6761ebdd7bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ed2a05-db4e-45a3-9c4b-6761ebdd7bb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:26:44Z,deleted=False,deleted_at=None,display_description='',display_name='9ca377e4-2531-45db-a57a-754a6aaaf5ad-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22930ece-a42f-4661-977a-788270ce1121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a1b703b7904376a2c5c9a63c0cb0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:26:45Z,use_quota=True,user_id='e394aaff8f7448c2908897d5615ffb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e17a41f-8191-4147-b3d2-8c3ca9e58e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e17a41f-8191-4147-b3d2-8c3ca9e58e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294e2f4a-231f-43ed-a1cb-d03437fc753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294e2f4a-231f-43ed-a1cb-d03437fc753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22930ece-a42f-4661-977a-788270ce1121', 'volume_name': 'volume-22930ece-a42f-4661-977a-788270ce1121', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d260106-fe0a-4f56-8bb6-7402fdb77244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d260106-fe0a-4f56-8bb6-7402fdb77244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc8663e-1cab-42c3-ac7a-d662285f658a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:45 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Volume 22930ece-a42f-4661-977a-788270ce1121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22930ece-a42f-4661-977a-788270ce1121', 'volume_size': 1}
Apr 21 02:26:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:26:45 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
Apr 21 02:26:45 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 21 02:26:45 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 21 02:26:45 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 21 02:26:45 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 21 02:26:45 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 21 02:26:45 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 21 02:26:45 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 21 02:26:45 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
Apr 21 02:26:46 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning:
Apr 21 02:26:46 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Apr 21 02:26:46 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Apr 21 02:26:46 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 21 02:26:46 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Apr 21 02:26:46 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Apr 21 02:26:46 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Apr 21 02:26:46 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log: 
Apr 21 02:26:46 devstack cinder-volume[82686]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Flow 'volume_create_manager' (9bdcae96-7332-4aee-a582-6faa88b3974d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f866d2d-3fe4-4f0d-bbe1-0cc249201c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f866d2d-3fe4-4f0d-bbe1-0cc249201c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1998044261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8774e86-2268-42e2-8490-db21b48d9e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92b2afd5ec40a5ada1b7ad7cde0116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:26:47Z,use_quota=True,user_id='9d9a26ced8924291bf5319d2b0a56552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d22267c-eb79-492b-91dd-7f244f0bd0b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d22267c-eb79-492b-91dd-7f244f0bd0b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3d5e63-ba97-4aff-ba5c-8412cf2a49f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3d5e63-ba97-4aff-ba5c-8412cf2a49f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8774e86-2268-42e2-8490-db21b48d9e0d', 'volume_name': 'volume-f8774e86-2268-42e2-8490-db21b48d9e0d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c0661f-b8ea-4141-b046-09ae39233700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89c0661f-b8ea-4141-b046-09ae39233700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eca8a7b-59a2-4369-b690-ef121282e056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:46 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Volume f8774e86-2268-42e2-8490-db21b48d9e0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8774e86-2268-42e2-8490-db21b48d9e0d', 'volume_size': 1}
Apr 21 02:26:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:26:47 devstack sudo[83774]: pam_unix(sudo:session): session closed for user root
Apr 21 02:26:47 devstack cinder-volume[82686]: INFO oslo.privsep.daemon [req-5bb7f9df-f618-4832-8b29-c7f9f55033a0 req-a7f53a4f-18ee-4349-aa83-56edf4afd8c9 tempest-DeleteServersTestJSON-1690048183 None] Spawned new privsep daemon via rootwrap
Apr 21 02:26:47 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [req-5bb7f9df-f618-4832-8b29-c7f9f55033a0 req-a7f53a4f-18ee-4349-aa83-56edf4afd8c9 tempest-DeleteServersTestJSON-1690048183 None] Accepted privsep connection to /tmp/tmpw16obgrn/privsep.sock {{(pid=82686) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}}
Apr 21 02:26:47 devstack cinder-volume[82686]: INFO oslo.privsep.daemon [-] privsep daemon starting
Apr 21 02:26:47 devstack cinder-volume[82686]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Apr 21 02:26:47 devstack cinder-volume[82686]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Apr 21 02:26:47 devstack cinder-volume[82686]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83822
Apr 21 02:26:47 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08dccf8-e66d-40ad-8316-054d4ee49d95]: (2,) {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:26:47 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[602d9fe3-92cf-42af-967a-0b7fc603cdf6]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:26:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-5bb7f9df-f618-4832-8b29-c7f9f55033a0 req-a7f53a4f-18ee-4349-aa83-56edf4afd8c9 tempest-DeleteServersTestJSON-1690048183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:26:47 devstack sudo[83825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611
Apr 21 02:26:47 devstack sudo[83825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:26:48 devstack sudo[83825]: pam_unix(sudo:session): session closed for user root
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-5bb7f9df-f618-4832-8b29-c7f9f55033a0 req-a7f53a4f-18ee-4349-aa83-56edf4afd8c9 tempest-DeleteServersTestJSON-1690048183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611" returned: 0 in 0.824s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-5bb7f9df-f618-4832-8b29-c7f9f55033a0 req-a7f53a4f-18ee-4349-aa83-56edf4afd8c9 tempest-DeleteServersTestJSON-1690048183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.735s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.904s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:26:44Z,deleted=False,deleted_at=None,display_description='',display_name='9ca377e4-2531-45db-a57a-754a6aaaf5ad-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22930ece-a42f-4661-977a-788270ce1121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a1b703b7904376a2c5c9a63c0cb0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:26:45Z,use_quota=True,user_id='e394aaff8f7448c2908897d5615ffb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Creating volume 22930ece-a42f-4661-977a-788270ce1121 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:26:48 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:26:48 devstack sudo[83830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121 1073741824
Apr 21 02:26:48 devstack sudo[83830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:26:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-5bb7f9df-f618-4832-8b29-c7f9f55033a0 req-a7f53a4f-18ee-4349-aa83-56edf4afd8c9 tempest-DeleteServersTestJSON-1690048183 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049', 'name': 'volume-1f44f891-d904-42c2-980d-26a6ac392611', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95da3b74-8711-4540-b687-ac862292e4e0', 'enforce_multipath': True} {{(pid=82686) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 21 02:26:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-5bb7f9df-f618-4832-8b29-c7f9f55033a0 req-a7f53a4f-18ee-4349-aa83-56edf4afd8c9 tempest-DeleteServersTestJSON-1690048183 None] attachment_update completed successfully.
Apr 21 02:26:49 devstack sudo[83830]: pam_unix(sudo:session): session closed for user root
Apr 21 02:26:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121 1073741824" returned: 0 in 1.925s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:26:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:26:50 devstack sudo[83946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121
Apr 21 02:26:50 devstack sudo[83946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:26:51 devstack sudo[83946]: pam_unix(sudo:session): session closed for user root
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121" returned: 0 in 1.184s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] <== create_volume: return (3169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.172s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.294s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1998044261',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8774e86-2268-42e2-8490-db21b48d9e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92b2afd5ec40a5ada1b7ad7cde0116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:26:47Z,use_quota=True,user_id='9d9a26ced8924291bf5319d2b0a56552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Creating volume f8774e86-2268-42e2-8490-db21b48d9e0d {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:26:51 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:26:51 devstack sudo[84273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d 1073741824
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afc8663e-1cab-42c3-ac7a-d662285f658a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22930ece-a42f-4661-977a-788270ce1121', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03716042-527b-4d35-bb4b-28d7b10f3876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:51 devstack sudo[84273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:26:51 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Volume volume-22930ece-a42f-4661-977a-788270ce1121 (22930ece-a42f-4661-977a-788270ce1121): created successfully
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03716042-527b-4d35-bb4b-28d7b10f3876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Flow 'volume_create_manager' (80f4e6ed-f79b-4624-855c-97b3f3c57e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:26:51 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-c51524dd-8ba8-42e0-a88d-1baffc435e7c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Created volume successfully.
Apr 21 02:26:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-e7f2ca32-a0f2-4541-82bc-6c1ed37a57a6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:26:52 devstack sudo[84273]: pam_unix(sudo:session): session closed for user root
Apr 21 02:26:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d 1073741824" returned: 0 in 1.421s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:26:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:26:52 devstack sudo[84292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d
Apr 21 02:26:52 devstack sudo[84292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:26:53 devstack sudo[84292]: pam_unix(sudo:session): session closed for user root
Apr 21 02:26:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d" returned: 0 in 0.878s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:26:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] <== create_volume: return (2376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:26:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.381s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:26:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-e7f2ca32-a0f2-4541-82bc-6c1ed37a57a6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.545s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:26:53 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d8e9f5-91e7-4691-b0ef-5a30cd2d5d6d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:26:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eca8a7b-59a2-4369-b690-ef121282e056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8774e86-2268-42e2-8490-db21b48d9e0d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b63bfa1-1dc8-4644-9c53-b844e399e4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-e7f2ca32-a0f2-4541-82bc-6c1ed37a57a6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:26:53 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Volume volume-f8774e86-2268-42e2-8490-db21b48d9e0d (f8774e86-2268-42e2-8490-db21b48d9e0d): created successfully
Apr 21 02:26:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b63bfa1-1dc8-4644-9c53-b844e399e4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Flow 'volume_create_manager' (9bdcae96-7332-4aee-a582-6faa88b3974d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:26:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-cca143a4-5aee-40fe-86b7-292d35d30df0 tempest-ServersNegativeTestJSON-1840366264 None] Created volume successfully.
Apr 21 02:26:53 devstack sudo[84307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121
Apr 21 02:26:53 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:26:54 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root
Apr 21 02:26:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-e7f2ca32-a0f2-4541-82bc-6c1ed37a57a6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121" returned: 0 in 1.232s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:26:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-e7f2ca32-a0f2-4541-82bc-6c1ed37a57a6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.269s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:26:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-e7f2ca32-a0f2-4541-82bc-6c1ed37a57a6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049', 'name': 'volume-22930ece-a42f-4661-977a-788270ce1121', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7ba89c49-373b-4421-997c-f7480b8a3371', 'enforce_multipath': True} {{(pid=82686) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 21 02:26:55 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-4fb80178-c329-41a6-8b14-94b3a54ad259 req-e7f2ca32-a0f2-4541-82bc-6c1ed37a57a6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] attachment_update completed successfully.
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Flow 'volume_create_manager' (3904eb37-d6f9-4609-854b-0ef306050eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3347009-592f-4851-9670-3a60b2e42f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3347009-592f-4851-9670-3a60b2e42f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-831224972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c4e472-fa72-452f-b8ea-29a7d8e5d8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92b2afd5ec40a5ada1b7ad7cde0116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:26:57Z,use_quota=True,user_id='9d9a26ced8924291bf5319d2b0a56552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef72089e-5c0d-48a4-ba9d-7ec81d0c2364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef72089e-5c0d-48a4-ba9d-7ec81d0c2364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d47f22f-cfd6-4e09-99d5-0c89e09219d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d47f22f-cfd6-4e09-99d5-0c89e09219d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c4e472-fa72-452f-b8ea-29a7d8e5d8c9', 'volume_name': 'volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f095e6-9f47-4ad0-a5e2-2116acc0c1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f095e6-9f47-4ad0-a5e2-2116acc0c1cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9119bee5-b437-4fdf-b667-6c3719594303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:57 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Volume 75c4e472-fa72-452f-b8ea-29a7d8e5d8c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9', 'volume_size': 1}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-831224972',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c4e472-fa72-452f-b8ea-29a7d8e5d8c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c92b2afd5ec40a5ada1b7ad7cde0116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:26:57Z,use_quota=True,user_id='9d9a26ced8924291bf5319d2b0a56552',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Creating volume 75c4e472-fa72-452f-b8ea-29a7d8e5d8c9 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:26:57 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:26:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:26:57 devstack sudo[84430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9 1073741824
Apr 21 02:26:57 devstack sudo[84430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:26:58 devstack sudo[84430]: pam_unix(sudo:session): session closed for user root
Apr 21 02:26:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9 1073741824" returned: 0 in 0.554s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:26:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:26:58 devstack sudo[84473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9
Apr 21 02:26:58 devstack sudo[84473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:26:58 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-5ad2f776-cf30-4523-979b-e10c8bdf8945 req-b6e36889-959e-4731-a7a1-992b44e059e4 tempest-DeleteServersTestJSON-1690048183 None] Terminate volume connection completed successfully.
Apr 21 02:26:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-5ad2f776-cf30-4523-979b-e10c8bdf8945 req-b6e36889-959e-4731-a7a1-992b44e059e4 tempest-DeleteServersTestJSON-1690048183 None] Deleting attachment 95da3b74-8711-4540-b687-ac862292e4e0. {{(pid=82686) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 21 02:26:58 devstack sudo[84473]: pam_unix(sudo:session): session closed for user root
Apr 21 02:26:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9" returned: 0 in 0.655s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:26:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:26:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:26:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9119bee5-b437-4fdf-b667-6c3719594303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fab8870-8ed6-442c-85e0-89dffc7ffdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:26:58 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Volume volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9 (75c4e472-fa72-452f-b8ea-29a7d8e5d8c9): created successfully
Apr 21 02:26:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fab8870-8ed6-442c-85e0-89dffc7ffdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:26:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Flow 'volume_create_manager' (3904eb37-d6f9-4609-854b-0ef306050eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:26:58 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6b395d7e-7ece-4a9e-b872-b45f106cb6a4 tempest-ServersNegativeTestJSON-1840366264 None] Created volume successfully.
Apr 21 02:26:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Acquiring lock "cinder-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:26:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Lock "cinder-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:26:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Acquiring lock "cinder-quobyte-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:26:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Lock "cinder-quobyte-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:26:59 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91ea06d-a7c4-4220-a71a-3c28d6372bc5]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:26:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:00 devstack sudo[84479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9
Apr 21 02:27:00 devstack sudo[84479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:00 devstack sudo[84479]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9" returned: 0 in 1.039s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:01 devstack sudo[84819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9
Apr 21 02:27:01 devstack sudo[84819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:01 devstack sudo[84819]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9" returned: 0 in 0.637s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Lock "cinder-quobyte-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9" released by "delete_volume" :: held 1.699s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:01 devstack cinder-volume[82686]: WARNING cinder.quota [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:27:01 devstack cinder-volume[82686]: WARNING cinder.quota [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:27:01 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Created reservations ['b9a28980-ec43-421e-b364-bd30992cc689', 'ed7a59cb-a3b2-40c1-ad80-5316edbc3787', 'bd5317e7-d4fd-4364-9397-8e9f5e3cfd1f', 'f8153f43-c66e-454b-9f58-ac0789d90fe4'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:01 devstack sudo[84823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:01 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Acquiring lock "cinder-f8774e86-2268-42e2-8490-db21b48d9e0d-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Lock "cinder-f8774e86-2268-42e2-8490-db21b48d9e0d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Acquiring lock "cinder-quobyte-f8774e86-2268-42e2-8490-db21b48d9e0d" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Lock "cinder-quobyte-f8774e86-2268-42e2-8490-db21b48d9e0d" acquired by "delete_volume" :: waited 0.034s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e75f1b2-848f-41a7-a7c6-d75ccd016b84]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Acquiring lock "cinder-1f44f891-d904-42c2-980d-26a6ac392611-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Lock "cinder-1f44f891-d904-42c2-980d-26a6ac392611-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:02 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:02 devstack sudo[84826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d
Apr 21 02:27:02 devstack sudo[84826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.777s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:02 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Deleted volume successfully.
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Acquiring lock "cinder-quobyte-1f44f891-d904-42c2-980d-26a6ac392611" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Lock "cinder-quobyte-1f44f891-d904-42c2-980d-26a6ac392611" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc75a488-1503-4df3-9f9f-a4a6059c7abe]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-21626e40-bb5c-49e8-b4c3-07d4f48c0cbb tempest-ServersNegativeTestJSON-1840366264 None] Lock "cinder-75c4e472-fa72-452f-b8ea-29a7d8e5d8c9-delete_volume" released by "delete_volume" :: held 2.798s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:02 devstack sudo[84831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611
Apr 21 02:27:02 devstack sudo[84831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG oslo_service.periodic_task [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82686) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:03 devstack sudo[84834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:03 devstack sudo[84834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:03 devstack sudo[84826]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d" returned: 0 in 1.263s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:03 devstack sudo[84842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d
Apr 21 02:27:03 devstack sudo[84842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:03 devstack sudo[84831]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611" returned: 0 in 1.206s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:03 devstack sudo[84846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611
Apr 21 02:27:03 devstack sudo[84846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:03 devstack sudo[84834]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.998s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:03 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:04 devstack sudo[84842]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f8774e86-2268-42e2-8490-db21b48d9e0d" returned: 0 in 0.639s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Lock "cinder-quobyte-f8774e86-2268-42e2-8490-db21b48d9e0d" released by "delete_volume" :: held 1.927s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Created reservations ['d5dcf865-2669-4c94-8c1e-2c75c91b719c', '94b0daea-4bd1-42a6-b88e-f36d7beb9a29', 'e2c76b54-3cca-48d1-97c8-7eb7cb23d627', '79ac459f-da24-419b-8767-bcecebb21610'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:04 devstack sudo[84850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:04 devstack sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:04 devstack sudo[84846]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1f44f891-d904-42c2-980d-26a6ac392611" returned: 0 in 0.779s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Lock "cinder-quobyte-1f44f891-d904-42c2-980d-26a6ac392611" released by "delete_volume" :: held 2.031s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Created reservations ['a6c8bdea-e840-48b3-9bec-aaac6f3c2e46', 'bee8d1ea-e297-4f03-a60e-b610797d2551', '9018c57f-4166-494c-9560-b9f9ed684957', 'd94fb4a7-ea78-4e14-a9e6-21346abfb066'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:04 devstack sudo[84854]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:04 devstack sudo[84854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:05 devstack sudo[84850]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.681s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:05 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:05 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Deleted volume successfully.
Apr 21 02:27:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dbf14ff0-a10b-42ea-8a63-9948907224c7 tempest-ServersNegativeTestJSON-1840366264 None] Lock "cinder-f8774e86-2268-42e2-8490-db21b48d9e0d-delete_volume" released by "delete_volume" :: held 2.935s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:05 devstack sudo[84854]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.521s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:05 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:05 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Deleted volume successfully.
Apr 21 02:27:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f7162a73-9524-4d72-bc03-d614e5614ea0 tempest-DeleteServersTestJSON-1690048183 None] Lock "cinder-1f44f891-d904-42c2-980d-26a6ac392611-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:11 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ad71f7b4-61f3-46d7-b76d-a84bad40ce72 tempest-GroupSnapshotsV319Test-1107557787 None] Group tempest-GroupSnapshotsV319Test-Group-248567237: creating
Apr 21 02:27:11 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ad71f7b4-61f3-46d7-b76d-a84bad40ce72 tempest-GroupSnapshotsV319Test-1107557787 None] Group tempest-GroupSnapshotsV319Test-Group-248567237: created successfully
Apr 21 02:27:11 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ad71f7b4-61f3-46d7-b76d-a84bad40ce72 tempest-GroupSnapshotsV319Test-1107557787 None] Create group completed successfully.
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Flow 'volume_create_manager' (9c90aebc-47f9-4c60-8527-938e301f6998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8507e293-9064-4a66-acd2-1291634db960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8507e293-9064-4a66-acd2-1291634db960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1539407894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a47631d-868a-4edc-ab1c-d553e3bb8a3e,host='devstack@QuobyteHD#QuobyteHD',id=247b91e8-670a-4060-818d-ccfa8e8d1362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88b0b53861f45a091c1547e3435adab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:13Z,use_quota=True,user_id='95649517970241afa4cfab4164139d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(178c574b-b731-40fd-b16b-6e757bc5fc1b),volume_type_id=178c574b-b731-40fd-b16b-6e757bc5fc1b)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f331ca-cd07-46dc-92ae-63007b32a85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63f331ca-cd07-46dc-92ae-63007b32a85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a859b93-5745-412f-9219-0aac202ce732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a859b93-5745-412f-9219-0aac202ce732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '247b91e8-670a-4060-818d-ccfa8e8d1362', 'volume_name': 'volume-247b91e8-670a-4060-818d-ccfa8e8d1362', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258bf781-c5c9-4d6d-9c1c-70a491820fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258bf781-c5c9-4d6d-9c1c-70a491820fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca7038e-f982-471c-859d-732a767bd508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:12 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Volume 247b91e8-670a-4060-818d-ccfa8e8d1362: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-247b91e8-670a-4060-818d-ccfa8e8d1362', 'volume_size': 1}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8a47631d-868a-4edc-ab1c-d553e3bb8a3e,created_at=2026-04-21T00:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1539407894',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8a47631d-868a-4edc-ab1c-d553e3bb8a3e,host='devstack@QuobyteHD#QuobyteHD',id=247b91e8-670a-4060-818d-ccfa8e8d1362,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d88b0b53861f45a091c1547e3435adab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:13Z,use_quota=True,user_id='95649517970241afa4cfab4164139d6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(178c574b-b731-40fd-b16b-6e757bc5fc1b),volume_type_id=178c574b-b731-40fd-b16b-6e757bc5fc1b)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Creating volume 247b91e8-670a-4060-818d-ccfa8e8d1362 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:27:12 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:27:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:12 devstack sudo[84956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362 1073741824
Apr 21 02:27:12 devstack sudo[84956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:13 devstack sudo[84956]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362 1073741824" returned: 0 in 0.561s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:13 devstack sudo[84962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362
Apr 21 02:27:13 devstack sudo[84962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:13 devstack sudo[84962]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362" returned: 0 in 0.453s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:27:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:13 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ca7038e-f982-471c-859d-732a767bd508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-247b91e8-670a-4060-818d-ccfa8e8d1362', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:13 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1851d4ee-9a1f-4b73-8920-a52fdcfba090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:13 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Volume volume-247b91e8-670a-4060-818d-ccfa8e8d1362 (247b91e8-670a-4060-818d-ccfa8e8d1362): created successfully
Apr 21 02:27:13 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1851d4ee-9a1f-4b73-8920-a52fdcfba090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:13 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Flow 'volume_create_manager' (9c90aebc-47f9-4c60-8527-938e301f6998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:13 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-221a7380-5b91-4f8d-adca-8810acc319a8 tempest-GroupSnapshotsV319Test-1107557787 None] Created volume successfully.
Apr 21 02:27:15 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] GroupSnapshot 46b5a52d-0b86-4d02-88b5-87a1d2f5ca26: creating.
Apr 21 02:27:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] Group snapshot 46b5a52d-0b86-4d02-88b5-87a1d2f5ca26: creating. {{(pid=82686) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 21 02:27:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] Creating offline snapshot bcd17e79-ea14-433f-bb66-7890a9614a2b of volume 247b91e8-670a-4060-818d-ccfa8e8d1362 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:27:15 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ac9249-63a6-4071-a66c-762874d0654d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:15 devstack sudo[84967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362
Apr 21 02:27:15 devstack sudo[84967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:15 devstack sudo[84967]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362" returned: 0 in 0.602s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:15 devstack sudo[84979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b 1G
Apr 21 02:27:15 devstack sudo[84979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:16 devstack sudo[84979]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b 1G" returned: 0 in 0.616s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247b91e8-670a-4060-818d-ccfa8e8d1362 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:16 devstack sudo[85018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247b91e8-670a-4060-818d-ccfa8e8d1362 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b
Apr 21 02:27:16 devstack sudo[85018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:16 devstack sudo[85018]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-247b91e8-670a-4060-818d-ccfa8e8d1362 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b" returned: 0 in 0.628s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:16 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:27:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:17 devstack sudo[85027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b
Apr 21 02:27:17 devstack sudo[85027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Flow 'volume_create_manager' (0117c5d1-2dc5-480c-955b-c981a2d4c7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a30330-bb77-47fe-8057-ad9c3e695d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a30330-bb77-47fe-8057-ad9c3e695d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1197080579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ab9d06-55b6-4146-b2b6-b1c0579fb221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3854de54c1324771928a909a510c240c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:17Z,use_quota=True,user_id='e310e66171a34937af78c5375fa90df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdde9eb2-83a4-42f7-a59b-31e20710227b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdde9eb2-83a4-42f7-a59b-31e20710227b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8a8821-c2a1-41cd-8461-eeb8a82186a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a8a8821-c2a1-41cd-8461-eeb8a82186a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ab9d06-55b6-4146-b2b6-b1c0579fb221', 'volume_name': 'volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736c5191-6b7c-4e7d-9c41-1f031a9b7ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736c5191-6b7c-4e7d-9c41-1f031a9b7ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe165ca-0ae7-4a14-9869-2d79ccab23f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:17 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Volume 60ab9d06-55b6-4146-b2b6-b1c0579fb221: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221', 'volume_size': 1}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:17 devstack sudo[85027]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b" returned: 0 in 0.736s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:17 devstack sudo[85078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.info
Apr 21 02:27:17 devstack sudo[85078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:18 devstack sudo[85078]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.info" returned: 0 in 0.554s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:18 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:18 devstack sudo[85082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.info
Apr 21 02:27:18 devstack sudo[85082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:18 devstack sudo[85082]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.info" returned: 0 in 0.471s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.694s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.171s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1197080579',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ab9d06-55b6-4146-b2b6-b1c0579fb221,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3854de54c1324771928a909a510c240c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:17Z,use_quota=True,user_id='e310e66171a34937af78c5375fa90df7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Creating volume 60ab9d06-55b6-4146-b2b6-b1c0579fb221 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:27:18 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:27:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:18 devstack sudo[85087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 1073741824
Apr 21 02:27:18 devstack sudo[85087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:18 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e7df1b64-dc49-4c81-9931-046b5889c2c2 tempest-GroupSnapshotsV319Test-1107557787 None] group_snapshot 46b5a52d-0b86-4d02-88b5-87a1d2f5ca26: created successfully
Apr 21 02:27:19 devstack sudo[85087]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 1073741824" returned: 0 in 0.942s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:19 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] group_snapshot 46b5a52d-0b86-4d02-88b5-87a1d2f5ca26: deleting
Apr 21 02:27:19 devstack sudo[85092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221
Apr 21 02:27:19 devstack sudo[85092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] group_snapshot 46b5a52d-0b86-4d02-88b5-87a1d2f5ca26: deleting {{(pid=82686) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 21 02:27:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Acquiring lock "cinder-quobyte-247b91e8-670a-4060-818d-ccfa8e8d1362" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Lock "cinder-quobyte-247b91e8-670a-4060-818d-ccfa8e8d1362" acquired by "delete_snapshot" :: waited 0.044s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Acquiring lock "cinder-quobyte-bcd17e79-ea14-433f-bb66-7890a9614a2b" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Lock "cinder-quobyte-bcd17e79-ea14-433f-bb66-7890a9614a2b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Deleting offline snapshot bcd17e79-ea14-433f-bb66-7890a9614a2b of volume 247b91e8-670a-4060-818d-ccfa8e8d1362 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:27:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] snapshot_file for this snap is: volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:27:19 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[07701f3a-7019-4204-bb0a-a87531bfa141]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:20 devstack sudo[85094]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b
Apr 21 02:27:20 devstack sudo[85094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:20 devstack sudo[85092]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221" returned: 0 in 0.580s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:27:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe165ca-0ae7-4a14-9869-2d79ccab23f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4df71e0-9dbd-43ec-a75d-e42f6c2ff16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:20 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Volume volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 (60ab9d06-55b6-4146-b2b6-b1c0579fb221): created successfully
Apr 21 02:27:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4df71e0-9dbd-43ec-a75d-e42f6c2ff16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Flow 'volume_create_manager' (0117c5d1-2dc5-480c-955b-c981a2d4c7a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:20 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-7abbbcbc-c37e-45d5-8573-14ab7ab8275d req-ab85af32-0d85-48ae-8180-733f28d24f89 tempest-VolumesSnapshotsTestJSON-1777443105 None] Created volume successfully.
Apr 21 02:27:20 devstack sudo[85094]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b" returned: 0 in 0.651s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-247b91e8-670a-4060-818d-ccfa8e8d1362(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:27:20 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0c1357-5b5d-474b-b3e2-fd8c8ac79fe9]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:20 devstack sudo[85124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362
Apr 21 02:27:20 devstack sudo[85124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] Creating offline snapshot 64021395-86c9-43ca-bcf9-54bb8079577d of volume 60ab9d06-55b6-4146-b2b6-b1c0579fb221 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7217ff-7ddd-47c6-b4d2-224e2ca24c7e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:21 devstack sudo[85152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221
Apr 21 02:27:21 devstack sudo[85152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Flow 'volume_create_manager' (3ff91d6d-c718-428f-bf21-757715e0fc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4846d1ab-228c-4b57-80d8-4c36ea832f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4846d1ab-228c-4b57-80d8-4c36ea832f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1677113593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbaa804-37ff-458d-8db7-4aa74f4be468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81833c6d55e4254acaa0131694ae365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:22Z,use_quota=True,user_id='6750b98a1dd64979bb9b016f8160ee78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39846d90-9e20-4b73-92e9-2893ce4cce04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39846d90-9e20-4b73-92e9-2893ce4cce04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30938da5-25d3-47fc-91fc-76eb2dadfa2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30938da5-25d3-47fc-91fc-76eb2dadfa2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afbaa804-37ff-458d-8db7-4aa74f4be468', 'volume_name': 'volume-afbaa804-37ff-458d-8db7-4aa74f4be468', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed42530f-2fe5-4afd-b232-47f6c0f0dde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed42530f-2fe5-4afd-b232-47f6c0f0dde1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d130e0-c7fd-46c1-b09a-bff7b685372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:21 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Volume afbaa804-37ff-458d-8db7-4aa74f4be468: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afbaa804-37ff-458d-8db7-4aa74f4be468', 'volume_size': 1}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:21 devstack sudo[85124]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362" returned: 0 in 1.306s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:21 devstack sudo[85159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b
Apr 21 02:27:21 devstack sudo[85159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:22 devstack sudo[85152]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221" returned: 0 in 0.837s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:22 devstack sudo[85164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d 1G
Apr 21 02:27:22 devstack sudo[85164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:22 devstack sudo[85159]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b" returned: 0 in 0.533s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:22 devstack sudo[85169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b
Apr 21 02:27:22 devstack sudo[85169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:22 devstack sudo[85164]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d 1G" returned: 0 in 0.573s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:22 devstack sudo[85174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d
Apr 21 02:27:22 devstack sudo[85174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:22 devstack sudo[85169]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362.bcd17e79-ea14-433f-bb66-7890a9614a2b" returned: 0 in 0.466s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Lock "cinder-quobyte-bcd17e79-ea14-433f-bb66-7890a9614a2b" released by "_delete_snapshot" :: held 3.019s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Lock "cinder-quobyte-247b91e8-670a-4060-818d-ccfa8e8d1362" released by "delete_snapshot" :: held 3.039s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:22 devstack cinder-volume[82686]: WARNING cinder.quota [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1761104982 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1761104982, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:27:22 devstack cinder-volume[82686]: WARNING cinder.quota [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1761104982 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1761104982, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:27:23 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] Created reservations ['e6f6c6de-2d10-417c-bdf1-b7928ac9b5bf', '0bbcbbc0-40b7-4531-a0b4-be9872527b6c', '1bd01f4b-d7e1-4bae-b14c-51c78da8a49e', '3013d4ea-0947-4558-8490-d3fb1f611cf4'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:23 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1d4eda53-87bb-4423-8c6a-d5e68b99e111 tempest-GroupSnapshotsV319Test-1107557787 None] group_snapshot 46b5a52d-0b86-4d02-88b5-87a1d2f5ca26: deleted successfully
Apr 21 02:27:23 devstack sudo[85174]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d" returned: 0 in 0.496s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:23 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d is being set with open permissions: ugo+rw
Apr 21 02:27:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:23 devstack sudo[85181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d
Apr 21 02:27:23 devstack sudo[85181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:23 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Acquiring lock "cinder-quobyte-247b91e8-670a-4060-818d-ccfa8e8d1362" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:23 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Lock "cinder-quobyte-247b91e8-670a-4060-818d-ccfa8e8d1362" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:23 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f5d1e9-5939-44c0-a27d-e7dc2bfb9b09]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:23 devstack sudo[85183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362
Apr 21 02:27:23 devstack sudo[85183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:23 devstack sudo[85181]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d" returned: 0 in 0.522s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:23 devstack sudo[85187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.info
Apr 21 02:27:23 devstack sudo[85187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:24 devstack sudo[85183]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362" returned: 0 in 0.599s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:24 devstack sudo[85196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362
Apr 21 02:27:24 devstack sudo[85196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:24 devstack sudo[85187]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.info" returned: 0 in 0.487s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:24 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.info is being set with open permissions: ugo+rw
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:24 devstack sudo[85198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.info
Apr 21 02:27:24 devstack sudo[85198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:24 devstack sudo[85196]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-247b91e8-670a-4060-818d-ccfa8e8d1362" returned: 0 in 0.458s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Lock "cinder-quobyte-247b91e8-670a-4060-818d-ccfa8e8d1362" released by "delete_volume" :: held 1.124s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Created reservations ['f76f4b0e-4449-46fd-8b7c-7ebeb522aa0c'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:24 devstack cinder-volume[82686]: WARNING cinder.quota [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1761104982 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1761104982, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:27:24 devstack sudo[85198]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.info" returned: 0 in 0.486s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.509s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.044s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1677113593',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afbaa804-37ff-458d-8db7-4aa74f4be468,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81833c6d55e4254acaa0131694ae365',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:22Z,use_quota=True,user_id='6750b98a1dd64979bb9b016f8160ee78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Creating volume afbaa804-37ff-458d-8db7-4aa74f4be468 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:27:24 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Created reservations ['3ff6f4c7-a9de-4a96-a0eb-277f6a0bd7db', 'e59b61ed-66b0-4185-8705-512df98ad4a4', '643dca64-bb9d-4ca6-8ec8-cd4fc287e6d4', '4202ec72-1da9-4fce-9a8b-57bc9e950253'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:24 devstack sudo[85204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468 1073741824
Apr 21 02:27:24 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:24 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-54ec6806-01c9-4bee-a38c-12b02582d780 req-d4e46081-ea40-487b-b426-ec5cf1372fa4 tempest-VolumesSnapshotsTestJSON-1777443105 None] Create snapshot completed successfully
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:24 devstack sudo[85206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:24 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:25 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.419s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:25 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-75fac6ef-d47a-4364-bc20-c514806517ab tempest-GroupSnapshotsV319Test-1107557787 None] Delete group completed successfully.
Apr 21 02:27:25 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468 1073741824" returned: 0 in 0.540s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:25 devstack sudo[85212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468
Apr 21 02:27:25 devstack sudo[85212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:25 devstack sudo[85212]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468" returned: 0 in 0.445s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d130e0-c7fd-46c1-b09a-bff7b685372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afbaa804-37ff-458d-8db7-4aa74f4be468', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2fe282-b493-43c2-804b-63befac3fb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:25 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Volume volume-afbaa804-37ff-458d-8db7-4aa74f4be468 (afbaa804-37ff-458d-8db7-4aa74f4be468): created successfully
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea2fe282-b493-43c2-804b-63befac3fb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Flow 'volume_create_manager' (3ff91d6d-c718-428f-bf21-757715e0fc1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:25 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d870bd3b-c981-4729-b98c-3f70b6d1b676 tempest-VolumesAdminNegativeTest-78893102 None] Created volume successfully.
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Acquiring lock "cinder-64021395-86c9-43ca-bcf9-54bb8079577d-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "cinder-64021395-86c9-43ca-bcf9-54bb8079577d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Acquiring lock "cinder-quobyte-60ab9d06-55b6-4146-b2b6-b1c0579fb221" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "cinder-quobyte-60ab9d06-55b6-4146-b2b6-b1c0579fb221" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Acquiring lock "cinder-quobyte-64021395-86c9-43ca-bcf9-54bb8079577d" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "cinder-quobyte-64021395-86c9-43ca-bcf9-54bb8079577d" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Deleting offline snapshot 64021395-86c9-43ca-bcf9-54bb8079577d of volume 60ab9d06-55b6-4146-b2b6-b1c0579fb221 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:27:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] snapshot_file for this snap is: volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:27:26 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a628bb96-0506-4090-9e4d-b33354001cde]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:26 devstack sudo[85215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d
Apr 21 02:27:26 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:26 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d" returned: 0 in 0.642s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:27:26 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[af34107f-1b99-4ff0-9136-ea32e48b07fe]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:26 devstack sudo[85220]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221
Apr 21 02:27:26 devstack sudo[85220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:27 devstack sudo[85220]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221" returned: 0 in 0.671s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:27 devstack sudo[85225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d
Apr 21 02:27:27 devstack sudo[85225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Acquiring lock "cinder-afbaa804-37ff-458d-8db7-4aa74f4be468-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Lock "cinder-afbaa804-37ff-458d-8db7-4aa74f4be468-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Acquiring lock "cinder-quobyte-afbaa804-37ff-458d-8db7-4aa74f4be468" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Lock "cinder-quobyte-afbaa804-37ff-458d-8db7-4aa74f4be468" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:27 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[240d0551-5211-4ab1-b43c-1b0598bd3247]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:27 devstack sudo[85227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468
Apr 21 02:27:27 devstack sudo[85227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:27 devstack sudo[85225]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d" returned: 0 in 0.583s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:27 devstack sudo[85232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d
Apr 21 02:27:27 devstack sudo[85232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:28 devstack sudo[85227]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468" returned: 0 in 0.644s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:28 devstack sudo[85237]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468
Apr 21 02:27:28 devstack sudo[85237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:28 devstack sudo[85232]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221.64021395-86c9-43ca-bcf9-54bb8079577d" returned: 0 in 0.588s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "cinder-quobyte-64021395-86c9-43ca-bcf9-54bb8079577d" released by "_delete_snapshot" :: held 2.545s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "cinder-quobyte-60ab9d06-55b6-4146-b2b6-b1c0579fb221" released by "delete_snapshot" :: held 2.563s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:28 devstack cinder-volume[82686]: WARNING cinder.quota [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:27:28 devstack cinder-volume[82686]: DEBUG cinder.quota [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Created reservations ['448f8fbd-5402-4e7a-adb7-2103511b6734', '0adcc99e-2e45-42fb-9029-33f5b34bb68e', '4dbbc9cf-739d-4c93-abeb-b22e57027524', 'd175f481-64f8-422e-82f6-d1d22a934f03'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:28 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Delete snapshot completed successfully.
Apr 21 02:27:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-ab7bae33-02f3-4604-b61a-ed523607d5a7 req-5f204f59-6f8b-4460-b937-3669b5d58fba tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "cinder-64021395-86c9-43ca-bcf9-54bb8079577d-delete_snapshot" released by "delete_snapshot" :: held 2.774s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:28 devstack sudo[85237]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-afbaa804-37ff-458d-8db7-4aa74f4be468" returned: 0 in 0.810s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Lock "cinder-quobyte-afbaa804-37ff-458d-8db7-4aa74f4be468" released by "delete_volume" :: held 1.491s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Created reservations ['6b6b41eb-414f-4748-9090-4b5fa88725e1', '35ae08af-f74a-4b54-bd8a-76648c8a8f2c', '2e85754a-42a0-4f50-baab-bfbb3d74e59e', '6d5146d5-935c-4970-b97c-461d34423777'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:29 devstack sudo[85241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:29 devstack sudo[85241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Acquiring lock "cinder-60ab9d06-55b6-4146-b2b6-b1c0579fb221-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "cinder-60ab9d06-55b6-4146-b2b6-b1c0579fb221-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Acquiring lock "cinder-quobyte-60ab9d06-55b6-4146-b2b6-b1c0579fb221" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "cinder-quobyte-60ab9d06-55b6-4146-b2b6-b1c0579fb221" acquired by "delete_volume" :: waited 0.021s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ce5188-6205-4ccb-9e5d-c3570f9c60eb]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:29 devstack sudo[85243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221
Apr 21 02:27:29 devstack sudo[85243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:29 devstack sudo[85241]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.740s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:29 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Deleted volume successfully.
Apr 21 02:27:29 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c11ff475-041d-4a3a-ad3f-6d40dcb979d4 tempest-VolumesAdminNegativeTest-78893102 None] Lock "cinder-afbaa804-37ff-458d-8db7-4aa74f4be468-delete_volume" released by "delete_volume" :: held 2.492s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:30 devstack sudo[85243]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221" returned: 0 in 0.775s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:30 devstack sudo[85250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221
Apr 21 02:27:30 devstack sudo[85250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:30 devstack sudo[85250]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-60ab9d06-55b6-4146-b2b6-b1c0579fb221" returned: 0 in 0.625s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "cinder-quobyte-60ab9d06-55b6-4146-b2b6-b1c0579fb221" released by "delete_volume" :: held 1.441s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:30 devstack cinder-volume[82686]: DEBUG cinder.quota [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Created reservations ['e0402c10-8b12-40e4-af12-87ea02dc6271', '9cd45e73-75ec-4149-a71a-113cdd170245', 'e75b2d1f-a061-4376-baf0-945db7569147', '5dcd2f1a-4570-4d0c-b235-6ce2ef05c4aa'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:31 devstack sudo[85297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:31 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:31 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.523s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:31 devstack cinder-volume[82686]: DEBUG cinder.manager [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:31 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Deleted volume successfully.
Apr 21 02:27:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-6e0ee76c-5f31-4434-a523-6aae2a95fea5 req-29e3b8ce-a445-4151-b043-306d3c9a20bc tempest-VolumesSnapshotsTestJSON-1777443105 None] Lock "cinder-60ab9d06-55b6-4146-b2b6-b1c0579fb221-delete_volume" released by "delete_volume" :: held 2.223s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:32 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:UPDATE=93,cinder:SELECT=78,cinder:DELETE=9,cinder:INSERT=23 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=90,cinder:INSERT=19,cinder:UPDATE=91,cinder:DELETE=4 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Flow 'volume_create_manager' (682efd00-2954-4841-b6fa-73914a9a7ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b96ac0d-11c9-48b0-97a0-4b93079eef8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b96ac0d-11c9-48b0-97a0-4b93079eef8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1807488354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b9c0e9-0ee7-4621-9832-4f14053348da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='438e8ad747ff4fd096cf08c0270e1d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:34Z,use_quota=True,user_id='dee4de2f3d294872bf99b526f4ffaffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878acd06-278a-4ca6-b46d-a8cb849316f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878acd06-278a-4ca6-b46d-a8cb849316f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11af8044-4425-495e-99be-915bf66f5e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11af8044-4425-495e-99be-915bf66f5e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81b9c0e9-0ee7-4621-9832-4f14053348da', 'volume_name': 'volume-81b9c0e9-0ee7-4621-9832-4f14053348da', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac57f0ce-8104-4d06-847d-70f4001e0a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac57f0ce-8104-4d06-847d-70f4001e0a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca320bc-5df3-4a5d-81ba-f9e1ff7c5256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:34 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Volume 81b9c0e9-0ee7-4621-9832-4f14053348da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81b9c0e9-0ee7-4621-9832-4f14053348da', 'volume_size': 1}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1807488354',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81b9c0e9-0ee7-4621-9832-4f14053348da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='438e8ad747ff4fd096cf08c0270e1d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:34Z,use_quota=True,user_id='dee4de2f3d294872bf99b526f4ffaffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Creating volume 81b9c0e9-0ee7-4621-9832-4f14053348da {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:27:34 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:27:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:34 devstack sudo[85308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da 1073741824
Apr 21 02:27:34 devstack sudo[85308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:35 devstack sudo[85308]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da 1073741824" returned: 0 in 0.570s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:35 devstack sudo[85313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da
Apr 21 02:27:35 devstack sudo[85313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:35 devstack sudo[85313]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da" returned: 0 in 0.451s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:27:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca320bc-5df3-4a5d-81ba-f9e1ff7c5256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81b9c0e9-0ee7-4621-9832-4f14053348da', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb44ec88-5291-4629-bf3d-e7bee5031de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:35 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Volume volume-81b9c0e9-0ee7-4621-9832-4f14053348da (81b9c0e9-0ee7-4621-9832-4f14053348da): created successfully
Apr 21 02:27:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb44ec88-5291-4629-bf3d-e7bee5031de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Flow 'volume_create_manager' (682efd00-2954-4841-b6fa-73914a9a7ad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:35 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-35b835fd-f17c-409c-a033-be494c026a6c tempest-VolumesTestJSON-1980081057 None] Created volume successfully.
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Flow 'volume_create_manager' (6b54773e-ed47-4878-96bb-4d0751cf29d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abf4389-de74-4f90-acef-1c95e66667bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9abf4389-de74-4f90-acef-1c95e66667bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2058863530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47888418-0691-4930-b466-dcfadd5abc8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='438e8ad747ff4fd096cf08c0270e1d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:37Z,use_quota=True,user_id='dee4de2f3d294872bf99b526f4ffaffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0305cdcc-c248-4c86-b859-b772d1974dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0305cdcc-c248-4c86-b859-b772d1974dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a60070-4382-41bb-b1b4-18b226b86701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a60070-4382-41bb-b1b4-18b226b86701) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47888418-0691-4930-b466-dcfadd5abc8c', 'volume_name': 'volume-47888418-0691-4930-b466-dcfadd5abc8c', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed3a60c-b393-4f9a-8200-3f40146059bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ed3a60c-b393-4f9a-8200-3f40146059bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1c6008-0bd2-4bc1-954e-d87dcabc4a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:37 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Volume 47888418-0691-4930-b466-dcfadd5abc8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47888418-0691-4930-b466-dcfadd5abc8c', 'volume_size': 1}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2058863530',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47888418-0691-4930-b466-dcfadd5abc8c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='438e8ad747ff4fd096cf08c0270e1d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:37Z,use_quota=True,user_id='dee4de2f3d294872bf99b526f4ffaffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Creating volume 47888418-0691-4930-b466-dcfadd5abc8c {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:27:37 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:27:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:37 devstack sudo[85358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c 1073741824
Apr 21 02:27:37 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:38 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c 1073741824" returned: 0 in 0.700s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:38 devstack sudo[85364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c
Apr 21 02:27:38 devstack sudo[85364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:38 devstack sudo[85364]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c" returned: 0 in 0.681s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:27:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e1c6008-0bd2-4bc1-954e-d87dcabc4a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47888418-0691-4930-b466-dcfadd5abc8c', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e47e4c4-d4f3-4bb4-ab09-0bbed9c14ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:38 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Volume volume-47888418-0691-4930-b466-dcfadd5abc8c (47888418-0691-4930-b466-dcfadd5abc8c): created successfully
Apr 21 02:27:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e47e4c4-d4f3-4bb4-ab09-0bbed9c14ee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Flow 'volume_create_manager' (6b54773e-ed47-4878-96bb-4d0751cf29d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:38 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f4add85d-3853-4ea5-93f1-ad0fd424ac82 tempest-VolumesTestJSON-1980081057 None] Created volume successfully.
Apr 21 02:27:39 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:27:39 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Flow 'volume_create_manager' (101be75f-1968-42a6-8743-7c2c13fed7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:39 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845e732a-e977-43a3-8661-de3a765cf7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845e732a-e977-43a3-8661-de3a765cf7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-506132373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060f760e-3049-4ef5-908a-b5d89f921938,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='438e8ad747ff4fd096cf08c0270e1d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:40Z,use_quota=True,user_id='dee4de2f3d294872bf99b526f4ffaffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418e9faf-06bc-4bd7-acf8-5d9981d25404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (418e9faf-06bc-4bd7-acf8-5d9981d25404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6683e8-41f4-4981-ae7f-f4cc0e0026f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c6683e8-41f4-4981-ae7f-f4cc0e0026f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '060f760e-3049-4ef5-908a-b5d89f921938', 'volume_name': 'volume-060f760e-3049-4ef5-908a-b5d89f921938', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88274ba3-ad7b-4ce3-be5b-65f6efd8f7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88274ba3-ad7b-4ce3-be5b-65f6efd8f7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b82bfa7-c17a-474f-a3e4-d1dd5e9afd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:40 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Volume 060f760e-3049-4ef5-908a-b5d89f921938: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-060f760e-3049-4ef5-908a-b5d89f921938', 'volume_size': 1}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-506132373',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=060f760e-3049-4ef5-908a-b5d89f921938,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='438e8ad747ff4fd096cf08c0270e1d67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:40Z,use_quota=True,user_id='dee4de2f3d294872bf99b526f4ffaffa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Creating volume 060f760e-3049-4ef5-908a-b5d89f921938 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:27:40 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:40 devstack sudo[85371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938 1073741824
Apr 21 02:27:40 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Flow 'volume_create_manager' (b10d5259-5a49-484d-bc7f-71cf70ccd3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0144bff8-01b7-4141-95c5-d045ec31deff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0144bff8-01b7-4141-95c5-d045ec31deff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1377160139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367e0cc4-e122-4950-a60f-723d5b29a6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7b523bb93a47bdb7d4deec70e6c097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:41Z,use_quota=True,user_id='bdb03e461d66492e96f29460515a7ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c560f45f-5aa1-4e2f-a6a5-d697fb83f62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c560f45f-5aa1-4e2f-a6a5-d697fb83f62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7adea6-90c2-4b8c-8cf4-4e017f384932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a7adea6-90c2-4b8c-8cf4-4e017f384932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '367e0cc4-e122-4950-a60f-723d5b29a6df', 'volume_name': 'volume-367e0cc4-e122-4950-a60f-723d5b29a6df', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc733dd-aff2-4295-983e-494ead97e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc733dd-aff2-4295-983e-494ead97e71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619ea92f-b0c0-4297-a203-e38eac39e604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:40 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Volume 367e0cc4-e122-4950-a60f-723d5b29a6df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-367e0cc4-e122-4950-a60f-723d5b29a6df', 'volume_size': 1}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:40 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938 1073741824" returned: 0 in 0.658s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:40 devstack sudo[85376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938
Apr 21 02:27:40 devstack sudo[85376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:41 devstack sudo[85376]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938" returned: 0 in 0.546s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.579s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1377160139',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=367e0cc4-e122-4950-a60f-723d5b29a6df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7b523bb93a47bdb7d4deec70e6c097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:41Z,use_quota=True,user_id='bdb03e461d66492e96f29460515a7ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Creating volume 367e0cc4-e122-4950-a60f-723d5b29a6df {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:27:41 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b82bfa7-c17a-474f-a3e4-d1dd5e9afd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-060f760e-3049-4ef5-908a-b5d89f921938', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b901540a-d4da-4e2c-8ae3-d6e0111d052b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:41 devstack sudo[85382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df 1073741824
Apr 21 02:27:41 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:41 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Volume volume-060f760e-3049-4ef5-908a-b5d89f921938 (060f760e-3049-4ef5-908a-b5d89f921938): created successfully
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b901540a-d4da-4e2c-8ae3-d6e0111d052b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Flow 'volume_create_manager' (101be75f-1968-42a6-8743-7c2c13fed7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:41 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9fe3c086-3605-4a1c-af02-37628bfa93dd tempest-VolumesTestJSON-1980081057 None] Created volume successfully.
Apr 21 02:27:41 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df 1073741824" returned: 0 in 0.628s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:41 devstack sudo[85387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df
Apr 21 02:27:41 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:42 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df" returned: 0 in 0.581s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (619ea92f-b0c0-4297-a203-e38eac39e604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-367e0cc4-e122-4950-a60f-723d5b29a6df', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165da79c-97d2-43c9-8821-0e61c34419f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:42 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Volume volume-367e0cc4-e122-4950-a60f-723d5b29a6df (367e0cc4-e122-4950-a60f-723d5b29a6df): created successfully
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (165da79c-97d2-43c9-8821-0e61c34419f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Flow 'volume_create_manager' (b10d5259-5a49-484d-bc7f-71cf70ccd3b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:42 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b061a7ac-fdf5-4bd6-94f9-0b11fdb1ed1f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Created volume successfully.
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Acquiring lock "cinder-367e0cc4-e122-4950-a60f-723d5b29a6df-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "cinder-367e0cc4-e122-4950-a60f-723d5b29a6df-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Acquiring lock "cinder-quobyte-367e0cc4-e122-4950-a60f-723d5b29a6df" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "cinder-quobyte-367e0cc4-e122-4950-a60f-723d5b29a6df" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[d282de1d-9646-4e13-bf43-a97f94cf7ecb]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:42 devstack sudo[85391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df
Apr 21 02:27:42 devstack sudo[85391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Acquiring lock "cinder-060f760e-3049-4ef5-908a-b5d89f921938-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Lock "cinder-060f760e-3049-4ef5-908a-b5d89f921938-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Acquiring lock "cinder-quobyte-060f760e-3049-4ef5-908a-b5d89f921938" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Lock "cinder-quobyte-060f760e-3049-4ef5-908a-b5d89f921938" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a9f3ca-b347-44fa-a32a-0fd0916f9260]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:43 devstack sudo[85394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938
Apr 21 02:27:43 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:43 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938" returned: 0 in 0.602s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:43 devstack sudo[85418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938
Apr 21 02:27:43 devstack sudo[85391]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:43 devstack sudo[85418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df" returned: 0 in 0.799s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:43 devstack sudo[85420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df
Apr 21 02:27:43 devstack sudo[85420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:44 devstack sudo[85418]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-060f760e-3049-4ef5-908a-b5d89f921938" returned: 0 in 0.494s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Lock "cinder-quobyte-060f760e-3049-4ef5-908a-b5d89f921938" released by "delete_volume" :: held 1.127s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Created reservations ['4c60d324-9a9b-4cb8-ad83-53a0c4ef51fe', '65bf6af8-59d3-4530-a0af-fc104048cd9f', 'ac698678-1d55-43d7-9506-a6aead26c1b8', 'c77bce2e-e326-4020-8c00-d6cd8d535fc0'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:44 devstack sudo[85434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:44 devstack sudo[85434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:44 devstack sudo[85420]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-367e0cc4-e122-4950-a60f-723d5b29a6df" returned: 0 in 0.622s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "cinder-quobyte-367e0cc4-e122-4950-a60f-723d5b29a6df" released by "delete_volume" :: held 1.451s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Created reservations ['7dd560e5-311a-44e9-a0dd-af304f237589', 'dcb4783b-d1ce-4dfb-9d8d-4e8555205074', '3d895ee4-960a-465d-a718-2f3c3b139c10', '00a8649f-36c9-4658-b225-d6a99e1ef2f8'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:44 devstack sudo[85436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:44 devstack sudo[85436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:44 devstack sudo[85434]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.623s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:44 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Deleted volume successfully.
Apr 21 02:27:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-38879f48-9dca-473a-b6bd-8961a2a1ca38 tempest-VolumesTestJSON-1980081057 None] Lock "cinder-060f760e-3049-4ef5-908a-b5d89f921938-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:45 devstack sudo[85436]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.624s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:45 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Deleted volume successfully.
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d2bf4a6-3ba8-4708-bbf4-bc92cd0019d9 tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "cinder-367e0cc4-e122-4950-a60f-723d5b29a6df-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Acquiring lock "cinder-47888418-0691-4930-b466-dcfadd5abc8c-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Lock "cinder-47888418-0691-4930-b466-dcfadd5abc8c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Acquiring lock "cinder-quobyte-47888418-0691-4930-b466-dcfadd5abc8c" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Lock "cinder-quobyte-47888418-0691-4930-b466-dcfadd5abc8c" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef572b93-8393-4bd9-9bae-f6495b11c0a5]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:45 devstack sudo[85440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c
Apr 21 02:27:45 devstack sudo[85440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Flow 'volume_create_manager' (aa671081-1687-4461-a961-f968dd575453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f939b102-87a4-4f9e-a15c-0f8ad6658546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f939b102-87a4-4f9e-a15c-0f8ad6658546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2034400902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0a261d-1d56-47ba-8ae3-1710c880a7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7b523bb93a47bdb7d4deec70e6c097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:46Z,use_quota=True,user_id='bdb03e461d66492e96f29460515a7ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65a0833-1b1c-4c5c-ac9f-05c6a92c7405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d65a0833-1b1c-4c5c-ac9f-05c6a92c7405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12399f4-b7df-4ae7-ab6e-01f5b44fab1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d12399f4-b7df-4ae7-ab6e-01f5b44fab1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc0a261d-1d56-47ba-8ae3-1710c880a7ee', 'volume_name': 'volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b3335b-f05b-4c1e-a73e-12b8a323ba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b3335b-f05b-4c1e-a73e-12b8a323ba47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778ff70c-6a75-49df-8f6b-5aad042ea2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:45 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Volume dc0a261d-1d56-47ba-8ae3-1710c880a7ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee', 'volume_size': 1}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2034400902',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc0a261d-1d56-47ba-8ae3-1710c880a7ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c7b523bb93a47bdb7d4deec70e6c097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:46Z,use_quota=True,user_id='bdb03e461d66492e96f29460515a7ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Creating volume dc0a261d-1d56-47ba-8ae3-1710c880a7ee {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:27:45 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:27:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:46 devstack sudo[85442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee 1073741824
Apr 21 02:27:46 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:46 devstack sudo[85440]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c" returned: 0 in 0.864s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:46 devstack sudo[85449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c
Apr 21 02:27:46 devstack sudo[85449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:46 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee 1073741824" returned: 0 in 0.794s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:46 devstack sudo[85453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee
Apr 21 02:27:46 devstack sudo[85453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:47 devstack sudo[85449]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-47888418-0691-4930-b466-dcfadd5abc8c" returned: 0 in 0.836s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Lock "cinder-quobyte-47888418-0691-4930-b466-dcfadd5abc8c" released by "delete_volume" :: held 1.744s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Created reservations ['5c4820bf-f67e-4f87-937d-eabb261daf65', '729c9f64-f9ba-4bfc-b022-b4576bcbb7bb', '1e5f2dcc-da54-4eed-bb07-2110b6c54e38', '8b568788-a8e1-4a0e-bd64-3ef92589662a'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:47 devstack sudo[85456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:47 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:47 devstack sudo[85453]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee" returned: 0 in 0.857s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (778ff70c-6a75-49df-8f6b-5aad042ea2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11c0216-c239-4724-9f78-5a3e8a474474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:47 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Volume volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee (dc0a261d-1d56-47ba-8ae3-1710c880a7ee): created successfully
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11c0216-c239-4724-9f78-5a3e8a474474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Flow 'volume_create_manager' (aa671081-1687-4461-a961-f968dd575453) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:47 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d289b593-ca10-4140-903c-a767946b229f tempest-VolumeQuotasAdminTestJSON-1732449393 None] Created volume successfully.
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Acquiring lock "cinder-81b9c0e9-0ee7-4621-9832-4f14053348da-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Lock "cinder-81b9c0e9-0ee7-4621-9832-4f14053348da-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Acquiring lock "cinder-quobyte-81b9c0e9-0ee7-4621-9832-4f14053348da" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Lock "cinder-quobyte-81b9c0e9-0ee7-4621-9832-4f14053348da" acquired by "delete_volume" :: waited 0.018s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1c6fc3-b0fa-4b40-aa58-3f5f2979f03e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:48 devstack sudo[85459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da
Apr 21 02:27:48 devstack sudo[85459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:48 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.815s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:48 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Deleted volume successfully.
Apr 21 02:27:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-40e80e62-5984-45c8-81fb-71e5d8a97e5e tempest-VolumesTestJSON-1980081057 None] Lock "cinder-47888418-0691-4930-b466-dcfadd5abc8c-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-552beda2-d1cc-440e-80bf-3e0f1137572c tempest-VolumeQuotasAdminTestJSON-888169069 None] Transfer volume completed successfully.
Apr 21 02:27:48 devstack sudo[85459]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da" returned: 0 in 0.999s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:48 devstack sudo[85469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da
Apr 21 02:27:48 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:49 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81b9c0e9-0ee7-4621-9832-4f14053348da" returned: 0 in 0.431s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Lock "cinder-quobyte-81b9c0e9-0ee7-4621-9832-4f14053348da" released by "delete_volume" :: held 1.492s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Created reservations ['6cd0a5de-582c-43ca-8397-868b0d620d13', '7731f8ca-9fff-4e8f-97d9-7d22bb2f03c2', '4ee249ce-c748-4d57-aca4-194afa80ece7', 'de5bbe56-9f36-42a3-b74d-1b389b68449f'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:49 devstack sudo[85474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:49 devstack sudo[85474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Acquiring lock "cinder-dc0a261d-1d56-47ba-8ae3-1710c880a7ee-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Lock "cinder-dc0a261d-1d56-47ba-8ae3-1710c880a7ee-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Acquiring lock "cinder-quobyte-dc0a261d-1d56-47ba-8ae3-1710c880a7ee" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Lock "cinder-quobyte-dc0a261d-1d56-47ba-8ae3-1710c880a7ee" acquired by "delete_volume" :: waited 0.022s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5acb698-9288-482b-a08e-056d5ca71602]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:49 devstack sudo[85476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee
Apr 21 02:27:49 devstack sudo[85476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:50 devstack sudo[85474]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.845s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:50 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:50 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Deleted volume successfully.
Apr 21 02:27:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dd998b63-127f-44be-8c89-baa1aa6a0610 tempest-VolumesTestJSON-1980081057 None] Lock "cinder-81b9c0e9-0ee7-4621-9832-4f14053348da-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:50 devstack sudo[85476]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee" returned: 0 in 0.681s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:50 devstack sudo[85483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee
Apr 21 02:27:50 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:51 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dc0a261d-1d56-47ba-8ae3-1710c880a7ee" returned: 0 in 0.656s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Lock "cinder-quobyte-dc0a261d-1d56-47ba-8ae3-1710c880a7ee" released by "delete_volume" :: held 1.358s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Created reservations ['b78b5b89-5ade-4f58-aea0-bf4062596350', '17781628-3cec-4034-97ab-c80620eb2111', 'cd420de8-a242-4fd5-b9a1-b14c89ab6612', '018961d7-7146-4ac0-9e15-a38308d3daa7'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:51 devstack sudo[85493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:27:51 devstack sudo[85493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:51 devstack sudo[85493]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.457s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:27:51 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Deleted volume successfully.
Apr 21 02:27:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7c91c794-1ee0-4801-9d0e-7b156c933343 tempest-VolumeQuotasAdminTestJSON-705155504 None] Lock "cinder-dc0a261d-1d56-47ba-8ae3-1710c880a7ee-delete_volume" released by "delete_volume" :: held 2.035s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:27:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-87ca18bf-f85b-405d-8311-3a58a15014b0 tempest-GroupSnapshotsTest-511687969 None] Group tempest-GroupSnapshotsTest-Group-934618070: creating
Apr 21 02:27:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-87ca18bf-f85b-405d-8311-3a58a15014b0 tempest-GroupSnapshotsTest-511687969 None] Group tempest-GroupSnapshotsTest-Group-934618070: created successfully
Apr 21 02:27:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-87ca18bf-f85b-405d-8311-3a58a15014b0 tempest-GroupSnapshotsTest-511687969 None] Create group completed successfully.
Apr 21 02:27:54 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:27:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Flow 'volume_create_manager' (86afe63a-4649-4f96-aab5-1b48fe70e441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675c5329-c18e-41a5-a01d-02122be661a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675c5329-c18e-41a5-a01d-02122be661a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2103324076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=240384ba-f76d-4fb5-9d63-46ba4cb613ff,host='devstack@QuobyteHD#QuobyteHD',id=3ed18d99-e08d-46d8-837b-c1ea700efd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d6d558d0bf4b7a957e3889e9cdce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:55Z,use_quota=True,user_id='07982a1d3b2e49b3a59cc96cdc4de189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f65b7c7a-183c-492a-b888-f501fad91ee3),volume_type_id=f65b7c7a-183c-492a-b888-f501fad91ee3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5d0efb-8d34-4731-b154-093709fd2231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad5d0efb-8d34-4731-b154-093709fd2231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2077859f-a7aa-48a5-ad2a-74ab59105e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2077859f-a7aa-48a5-ad2a-74ab59105e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed18d99-e08d-46d8-837b-c1ea700efd7f', 'volume_name': 'volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bb137c-5323-4f5c-ac1c-313c3c344653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73bb137c-5323-4f5c-ac1c-313c3c344653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5611a3ae-9008-4d84-bc98-4d354c6c0ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:55 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Volume 3ed18d99-e08d-46d8-837b-c1ea700efd7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f', 'volume_size': 1}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=240384ba-f76d-4fb5-9d63-46ba4cb613ff,created_at=2026-04-21T00:27:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2103324076',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=240384ba-f76d-4fb5-9d63-46ba4cb613ff,host='devstack@QuobyteHD#QuobyteHD',id=3ed18d99-e08d-46d8-837b-c1ea700efd7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d6d558d0bf4b7a957e3889e9cdce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:55Z,use_quota=True,user_id='07982a1d3b2e49b3a59cc96cdc4de189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f65b7c7a-183c-492a-b888-f501fad91ee3),volume_type_id=f65b7c7a-183c-492a-b888-f501fad91ee3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Creating volume 3ed18d99-e08d-46d8-837b-c1ea700efd7f {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:27:55 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:55 devstack sudo[85497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f 1073741824
Apr 21 02:27:55 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Flow 'volume_create_manager' (f610a1fb-de12-4261-80e8-f2ad7798da61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1047e5-c413-4d9d-87d3-9e14d7b9a5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a1047e5-c413-4d9d-87d3-9e14d7b9a5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:55Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2c6971-e368-4c6b-91fc-3dc4022a9c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a1b703b7904376a2c5c9a63c0cb0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:55Z,use_quota=True,user_id='e394aaff8f7448c2908897d5615ffb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896c3872-f79a-440d-b7b2-5f33db50f7a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (896c3872-f79a-440d-b7b2-5f33db50f7a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d534b1df-973b-481a-9c37-371f5ca3a5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:55 devstack cinder-volume[82686]: DEBUG cinder.image.glance [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Creating Keystone auth plugin from conf {{(pid=82686) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 21 02:27:56 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f 1073741824" returned: 0 in 1.009s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d534b1df-973b-481a-9c37-371f5ca3a5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c2c6971-e368-4c6b-91fc-3dc4022a9c73', 'volume_name': 'volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bd2523280>}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1587fe60-e0de-4031-82e0-84eb34024eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:56 devstack sudo[85504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f
Apr 21 02:27:56 devstack sudo[85504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1587fe60-e0de-4031-82e0-84eb34024eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8908f6f-01ac-456a-9ea4-2181f8fab99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:56 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Volume 8c2c6971-e368-4c6b-91fc-3dc4022a9c73: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bd2523280>}
Apr 21 02:27:56 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Trying to clone 8c2c6971-e368-4c6b-91fc-3dc4022a9c73 from image a37d0fba-01d8-4cd2-930f-61c0be29507e at location (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]). {{(pid=82686) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 21 02:27:56 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 21 02:27:56 devstack cinder-volume[82686]: INFO cinder.image.image_utils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Image download 20.69 MB at 20.69 MB/s
Apr 21 02:27:56 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced82e47-39e3-4673-816f-4c91b6532a9d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:56 devstack sudo[85528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD
Apr 21 02:27:56 devstack sudo[85528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:57 devstack sudo[85504]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f" returned: 0 in 1.079s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:27:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:57 devstack sudo[85528]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5611a3ae-9008-4d84-bc98-4d354c6c0ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4454b965-01a1-425a-9c2f-e4ae740502f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:27:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD" returned: 0 in 0.818s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:57 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Temporary image a37d0fba-01d8-4cd2-930f-61c0be29507e is fetched for user e394aaff8f7448c2908897d5615ffb54. {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 21 02:27:57 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Volume volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f (3ed18d99-e08d-46d8-837b-c1ea700efd7f): created successfully
Apr 21 02:27:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4454b965-01a1-425a-9c2f-e4ae740502f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:27:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Flow 'volume_create_manager' (86afe63a-4649-4f96-aab5-1b48fe70e441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:27:57 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-095e2600-d8d0-4028-81a7-f998fc4d364a tempest-GroupSnapshotsTest-511687969 None] Created volume successfully.
Apr 21 02:27:57 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2400cb-e846-4ef1-bd36-155aa37490de]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:27:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:57 devstack sudo[85588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD
Apr 21 02:27:57 devstack sudo[85588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:58 devstack sudo[85588]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD" returned: 0 in 1.065s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:27:55Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c2c6971-e368-4c6b-91fc-3dc4022a9c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08a1b703b7904376a2c5c9a63c0cb0a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:27:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:27:55Z,use_quota=True,user_id='e394aaff8f7448c2908897d5615ffb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Creating volume 8c2c6971-e368-4c6b-91fc-3dc4022a9c73 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:27:58 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:58 devstack sudo[85609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 1073741824
Apr 21 02:27:58 devstack sudo[85609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:27:58 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] GroupSnapshot 594ad27c-9274-4f00-ab6e-4620f9c01c72: creating.
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] Group snapshot 594ad27c-9274-4f00-ab6e-4620f9c01c72: creating. {{(pid=82686) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 21 02:27:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:27:59 devstack sudo[85609]: pam_unix(sudo:session): session closed for user root
Apr 21 02:27:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 1073741824" returned: 0 in 0.863s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:27:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:27:59 devstack sudo[85618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73
Apr 21 02:27:59 devstack sudo[85618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:00 devstack sudo[85618]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" returned: 0 in 0.930s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.640s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] Creating offline snapshot 4ed625c7-9f70-46de-9c1c-5f0db1450cbf of volume 3ed18d99-e08d-46d8-837b-c1ea700efd7f {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Attempting download of a37d0fba-01d8-4cd2-930f-61c0be29507e ((None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}])) to volume 8c2c6971-e368-4c6b-91fc-3dc4022a9c73. {{(pid=82686) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eee5381-d2de-4ed5-ab05-2fea4df8cd81]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[610f5019-a711-4278-948f-7a201f1e2591]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_0iz1e4up {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:00 devstack sudo[85628]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f
Apr 21 02:28:00 devstack sudo[85628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:00 devstack sudo[85629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_0iz1e4up
Apr 21 02:28:00 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Flow 'volume_create_manager' (68d106d4-c402-435b-8b74-4848cd26246e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f76823-3bf5-4e4a-b428-26b29309fe3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5f76823-3bf5-4e4a-b428-26b29309fe3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-705376651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b298b0-6b9b-437b-bac4-a6620ddbaf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a8b5c02fe7f4883a244dd699f9e6420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:28:01Z,use_quota=True,user_id='893b5f8229ae43788ce9392a50a8438d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebab368-f3bb-4fa2-aa51-3a6efcdb2699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ebab368-f3bb-4fa2-aa51-3a6efcdb2699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1615e738-df8a-4645-9576-29d32fdea55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1615e738-df8a-4645-9576-29d32fdea55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51b298b0-6b9b-437b-bac4-a6620ddbaf4c', 'volume_name': 'volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a48e3a-ee25-4046-8ed2-5998f96760c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50a48e3a-ee25-4046-8ed2-5998f96760c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fbad4b-e04d-490c-a3e2-1f7fb49d6377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:00 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Volume 51b298b0-6b9b-437b-bac4-a6620ddbaf4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c', 'volume_size': 1}
Apr 21 02:28:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:01 devstack sudo[85628]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f" returned: 0 in 0.790s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:01 devstack sudo[85636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf 1G
Apr 21 02:28:01 devstack sudo[85636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:01 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_0iz1e4up" returned: 0 in 0.965s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_0iz1e4up {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:01 devstack sudo[85641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_0iz1e4up
Apr 21 02:28:01 devstack sudo[85641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:01 devstack sudo[85636]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf 1G" returned: 0 in 0.620s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:01 devstack sudo[85646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf
Apr 21 02:28:01 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:01 devstack sudo[85641]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_0iz1e4up" returned: 1 in 0.640s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_0iz1e4up' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:28:01 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8551a8e0-d94b-44b8-8f7a-686049bc7c25]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:01 devstack sudo[85650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD
Apr 21 02:28:01 devstack sudo[85650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:02 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf" returned: 0 in 0.540s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:02 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:02 devstack sudo[85655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf
Apr 21 02:28:02 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:02 devstack sudo[85650]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD" returned: 0 in 0.566s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] a37d0fba-01d8-4cd2-930f-61c0be29507e was qcow2, converting to raw {{(pid=82686) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:02 devstack sudo[85660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73
Apr 21 02:28:02 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:02 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf" returned: 0 in 0.487s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:02 devstack sudo[85663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.info
Apr 21 02:28:02 devstack sudo[85663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG oslo_service.periodic_task [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82686) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:02 devstack sudo[85671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:28:02 devstack sudo[85671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:03 devstack sudo[85663]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.info" returned: 0 in 0.442s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:03 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:03 devstack sudo[85674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.info
Apr 21 02:28:03 devstack sudo[85674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:03 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" returned: 0 in 0.945s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_ivc1ny1ydevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:28:03 devstack cinder-volume[82686]: INFO cinder.image.image_utils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Converted 112.00 MB image at 112.00 MB/s
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:03 devstack sudo[85676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 1G
Apr 21 02:28:03 devstack sudo[85676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:03 devstack sudo[85674]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.info" returned: 0 in 0.496s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.484s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.899s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:28:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-705376651',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51b298b0-6b9b-437b-bac4-a6620ddbaf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a8b5c02fe7f4883a244dd699f9e6420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:28:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:28:01Z,use_quota=True,user_id='893b5f8229ae43788ce9392a50a8438d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Creating volume 51b298b0-6b9b-437b-bac4-a6620ddbaf4c {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:28:03 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:03 devstack sudo[85671]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:03 devstack sudo[85680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c 1073741824
Apr 21 02:28:03 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.811s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:03 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:28:03 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-83d8054f-cad7-43f5-95d2-a66853c8ef6c tempest-GroupSnapshotsTest-511687969 None] group_snapshot 594ad27c-9274-4f00-ab6e-4620f9c01c72: created successfully
Apr 21 02:28:04 devstack sudo[85676]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 1G" returned: 0 in 0.851s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:04 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[5087dbfb-df8b-4d95-85d6-33e32fe7708e]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:04 devstack sudo[85686]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73
Apr 21 02:28:04 devstack sudo[85686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:04 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c 1073741824" returned: 0 in 0.849s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:04 devstack sudo[85690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c
Apr 21 02:28:04 devstack sudo[85690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:05 devstack sudo[85686]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" returned: 0 in 0.827s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:05 devstack sudo[85694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73
Apr 21 02:28:05 devstack sudo[85694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:05 devstack sudo[85690]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c" returned: 0 in 0.813s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] <== create_volume: return (1695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:28:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0fbad4b-e04d-490c-a3e2-1f7fb49d6377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d35267-54c3-479f-898a-b609bc1a8c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:05 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Volume volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c (51b298b0-6b9b-437b-bac4-a6620ddbaf4c): created successfully
Apr 21 02:28:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44d35267-54c3-479f-898a-b609bc1a8c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Flow 'volume_create_manager' (68d106d4-c402-435b-8b74-4848cd26246e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:28:05 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-41495ad3-1ba7-4fcd-a697-d7747f03c57d tempest-VolumesServicesTestJSON-698902118 None] Created volume successfully.
Apr 21 02:28:06 devstack sudo[85694]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" returned: 1 in 0.957s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Downloaded image a37d0fba-01d8-4cd2-930f-61c0be29507e ((None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}])) to volume 8c2c6971-e368-4c6b-91fc-3dc4022a9c73 successfully. {{(pid=82686) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Temporary image a37d0fba-01d8-4cd2-930f-61c0be29507e for user e394aaff8f7448c2908897d5615ffb54 is deleted. {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Marking volume 8c2c6971-e368-4c6b-91fc-3dc4022a9c73 as bootable. {{(pid=82686) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Copying metadata from image a37d0fba-01d8-4cd2-930f-61c0be29507e to 8c2c6971-e368-4c6b-91fc-3dc4022a9c73. {{(pid=82686) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Creating volume glance metadata for volume 8c2c6971-e368-4c6b-91fc-3dc4022a9c73 backed by image a37d0fba-01d8-4cd2-930f-61c0be29507e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82686) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.013s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-4ed625c7-9f70-46de-9c1c-5f0db1450cbf-448ba774-7c33-4374-91f1-7282d1349a7d" by "_create_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-4ed625c7-9f70-46de-9c1c-5f0db1450cbf-448ba774-7c33-4374-91f1-7282d1349a7d" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Creating volume 448ba774-7c33-4374-91f1-7282d1349a7d from snapshot 4ed625c7-9f70-46de-9c1c-5f0db1450cbf {{(pid=82686) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-448ba774-7c33-4374-91f1-7282d1349a7d" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-448ba774-7c33-4374-91f1-7282d1349a7d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] snapshot: 4ed625c7-9f70-46de-9c1c-5f0db1450cbf, volume: 448ba774-7c33-4374-91f1-7282d1349a7d,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[22085266-3719-4cdc-9bbf-10e50e94fbba]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8908f6f-01ac-456a-9ea4-2181f8fab99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bd2523280>}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20baa89-8383-47c9-b93a-b72bae7f1e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:06 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Volume volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 (8c2c6971-e368-4c6b-91fc-3dc4022a9c73): created successfully
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d20baa89-8383-47c9-b93a-b72bae7f1e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Flow 'volume_create_manager' (f610a1fb-de12-4261-80e8-f2ad7798da61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:28:06 devstack sudo[85717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf
Apr 21 02:28:06 devstack sudo[85717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Acquiring lock "cinder-51b298b0-6b9b-437b-bac4-a6620ddbaf4c-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:06 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-5b25a74d-5698-4b60-8fc5-a490266330b6 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Created volume successfully.
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Lock "cinder-51b298b0-6b9b-437b-bac4-a6620ddbaf4c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Acquiring lock "cinder-quobyte-51b298b0-6b9b-437b-bac4-a6620ddbaf4c" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Lock "cinder-quobyte-51b298b0-6b9b-437b-bac4-a6620ddbaf4c" acquired by "delete_volume" :: waited 0.029s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc9df5c-31a0-48e9-8fdf-75eb998eba16]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:06 devstack sudo[85719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c
Apr 21 02:28:06 devstack sudo[85719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:07 devstack sudo[85717]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf" returned: 0 in 0.903s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:28:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:28:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:28:07 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[576a28dd-a8a5-4843-900a-83a353294fa4]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:07 devstack sudo[85724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f
Apr 21 02:28:07 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:07 devstack sudo[85719]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c" returned: 0 in 1.014s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:07 devstack sudo[85729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c
Apr 21 02:28:07 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:08 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f" returned: 0 in 0.808s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:08 devstack sudo[85737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d
Apr 21 02:28:08 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:08 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-51b298b0-6b9b-437b-bac4-a6620ddbaf4c" returned: 0 in 0.679s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Lock "cinder-quobyte-51b298b0-6b9b-437b-bac4-a6620ddbaf4c" released by "delete_volume" :: held 1.726s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Created reservations ['8c0c724e-cabd-4bca-bbc2-023e495a231f', '012c54c9-a16a-4862-af86-d7a7a828d6f4', '6766981f-7f8e-4bd0-9a16-125246fd5d34', '7257284f-85b4-469c-a334-b00c992fb93a'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-7c598af0-41a3-4bcc-862c-1b944c2fcf6d tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:08 devstack sudo[85758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:28:08 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:09 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.774s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:09 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:28:09 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Deleted volume successfully.
Apr 21 02:28:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de62f423-fb9c-474e-a8a2-1bca8c00516d tempest-VolumesServicesTestJSON-698902118 None] Lock "cinder-51b298b0-6b9b-437b-bac4-a6620ddbaf4c-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:11 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d" returned: 0 in 3.409s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:11 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35b5aed-bb9c-4f14-86aa-c73b3fa5af8a]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:11 devstack sudo[85822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f
Apr 21 02:28:11 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:12 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f" returned: 0 in 0.964s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:12 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f, size 1024.00 MB, duration 3.41 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:28:12 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Converted 1024.00 MB image at 300.29 MB/s
Apr 21 02:28:12 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:28:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:12 devstack sudo[85830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d
Apr 21 02:28:12 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:12 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d" returned: 0 in 0.440s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-448ba774-7c33-4374-91f1-7282d1349a7d" released by "_copy_volume_from_snapshot" :: held 6.629s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-4ed625c7-9f70-46de-9c1c-5f0db1450cbf-448ba774-7c33-4374-91f1-7282d1349a7d" released by "_create_volume_from_snapshot" :: held 6.662s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.682s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-7c598af0-41a3-4bcc-862c-1b944c2fcf6d tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.398s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:12 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d2eb1b-a887-4aaf-bf7b-776104b61226]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-7c598af0-41a3-4bcc-862c-1b944c2fcf6d tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:13 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6987c359-7aa9-4bf5-956d-b7793a797546 tempest-GroupSnapshotsTest-511687969 None] Create group from source-snapshot-594ad27c-9274-4f00-ab6e-4620f9c01c72 completed successfully.
Apr 21 02:28:13 devstack sudo[85833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73
Apr 21 02:28:13 devstack sudo[85833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-448ba774-7c33-4374-91f1-7282d1349a7d" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-448ba774-7c33-4374-91f1-7282d1349a7d" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:13 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[f709ebe5-ba1c-47e4-b7cd-cc5a14cb8aef]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:13 devstack sudo[85839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d
Apr 21 02:28:13 devstack sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:13 devstack sudo[85833]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-7c598af0-41a3-4bcc-862c-1b944c2fcf6d tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" returned: 0 in 0.753s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-7c598af0-41a3-4bcc-862c-1b944c2fcf6d tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:13 devstack sudo[85843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73
Apr 21 02:28:13 devstack sudo[85843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:14 devstack sudo[85839]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d" returned: 0 in 0.514s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:14 devstack sudo[85848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d
Apr 21 02:28:14 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:14 devstack sudo[85843]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-7c598af0-41a3-4bcc-862c-1b944c2fcf6d tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" returned: 1 in 0.733s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-7c598af0-41a3-4bcc-862c-1b944c2fcf6d tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:28:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-7c598af0-41a3-4bcc-862c-1b944c2fcf6d tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.568s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-7c598af0-41a3-4bcc-862c-1b944c2fcf6d tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049', 'name': 'volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17807eca-cfd6-491b-8e7a-0c8ea69aef7f', 'enforce_multipath': True} {{(pid=82686) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Apr 21 02:28:14 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-01d3845c-3235-4ca4-b824-b87104446ed0 req-7c598af0-41a3-4bcc-862c-1b944c2fcf6d tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] attachment_update completed successfully.
Apr 21 02:28:14 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-448ba774-7c33-4374-91f1-7282d1349a7d" returned: 0 in 0.815s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-448ba774-7c33-4374-91f1-7282d1349a7d" released by "delete_volume" :: held 1.353s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:14 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Created reservations ['e92a8022-fa1a-4b25-b84a-35181b32ac88'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:28:14 devstack cinder-volume[82686]: WARNING cinder.quota [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1002926120 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1002926120, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:28:14 devstack cinder-volume[82686]: WARNING cinder.quota [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1002926120 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1002926120, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:28:14 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Created reservations ['425f54b7-3ba3-42a2-8649-2bee397aa133', '955c90e1-a312-4fe7-92e4-d49b0ea6db6c', '2303917d-609a-4515-bd0a-c7cf6ba5f79f', '2db0901b-acf4-499d-93ad-f640bef1543a'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:28:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:15 devstack sudo[85880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:28:15 devstack sudo[85880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:15 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] group_snapshot 594ad27c-9274-4f00-ab6e-4620f9c01c72: deleting
Apr 21 02:28:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] group_snapshot 594ad27c-9274-4f00-ab6e-4620f9c01c72: deleting {{(pid=82686) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 21 02:28:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-3ed18d99-e08d-46d8-837b-c1ea700efd7f" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-3ed18d99-e08d-46d8-837b-c1ea700efd7f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-4ed625c7-9f70-46de-9c1c-5f0db1450cbf" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-4ed625c7-9f70-46de-9c1c-5f0db1450cbf" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Deleting offline snapshot 4ed625c7-9f70-46de-9c1c-5f0db1450cbf of volume 3ed18d99-e08d-46d8-837b-c1ea700efd7f {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:28:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] snapshot_file for this snap is: volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:28:16 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f5b547-0ea1-41ec-ae80-b1b2749c96cc]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:16 devstack sudo[85880]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 1.206s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:16 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:28:16 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-8c0056cf-5a6a-45b3-a7f7-7b9a02ce03fc tempest-GroupSnapshotsTest-511687969 None] Delete group completed successfully.
Apr 21 02:28:16 devstack sudo[85886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf
Apr 21 02:28:16 devstack sudo[85886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:17 devstack sudo[85886]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf" returned: 0 in 0.944s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:28:17 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[2385a38c-0ae3-42cd-8975-7d02d431e141]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:17 devstack sudo[85891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f
Apr 21 02:28:17 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:18 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f" returned: 0 in 1.258s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:18 devstack sudo[85901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf
Apr 21 02:28:18 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:18 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf" returned: 0 in 0.593s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:18 devstack sudo[85906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf
Apr 21 02:28:18 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:19 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f.4ed625c7-9f70-46de-9c1c-5f0db1450cbf" returned: 0 in 0.697s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-4ed625c7-9f70-46de-9c1c-5f0db1450cbf" released by "_delete_snapshot" :: held 3.584s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-3ed18d99-e08d-46d8-837b-c1ea700efd7f" released by "delete_snapshot" :: held 3.666s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:19 devstack cinder-volume[82686]: WARNING cinder.quota [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1002926120 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1002926120, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:28:19 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] Created reservations ['96b3740b-7e9f-4b4f-9b67-1318b4962ae6', '78fc4439-28d9-43bb-b881-d22c4668028c', 'f8f63131-fcee-47df-93dc-e4c33936d3df', '1a0ea6a0-04fb-4ebb-8710-fd2982bb1581'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:28:19 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-da62ec59-bc0f-46a8-af02-ff3feccdff7a tempest-GroupSnapshotsTest-511687969 None] group_snapshot 594ad27c-9274-4f00-ab6e-4620f9c01c72: deleted successfully
Apr 21 02:28:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-3ed18d99-e08d-46d8-837b-c1ea700efd7f" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-3ed18d99-e08d-46d8-837b-c1ea700efd7f" acquired by "delete_volume" :: waited 0.016s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:20 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7a64eb-70b6-481e-aa03-ac310fcf87c8]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:20 devstack sudo[85936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f
Apr 21 02:28:20 devstack sudo[85936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:21 devstack sudo[85936]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f" returned: 0 in 1.102s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:21 devstack sudo[85942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f
Apr 21 02:28:21 devstack sudo[85942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:22 devstack sudo[85942]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3ed18d99-e08d-46d8-837b-c1ea700efd7f" returned: 0 in 1.009s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-3ed18d99-e08d-46d8-837b-c1ea700efd7f" released by "delete_volume" :: held 2.226s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:23 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Created reservations ['f333b8e4-2d35-4fe6-b198-275f97271d1a'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:28:23 devstack cinder-volume[82686]: WARNING cinder.db.sqlalchemy.api [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1002926120']
Apr 21 02:28:23 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Created reservations ['0eaa2df7-5828-4b34-9a0b-a2f853859bc2', 'bf4363ca-913e-4980-b8aa-f31cdf3b853b', '1763984e-dd57-4096-bd68-4f1fac0fc5f2', '4dd9ef70-1710-4206-aaab-9ba65fc60496'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:28:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:23 devstack sudo[85971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:28:23 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:24 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.954s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:24 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:28:24 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-0a8f895c-a67c-4616-84d6-91eb05c604cb tempest-GroupSnapshotsTest-511687969 None] Delete group completed successfully.
Apr 21 02:28:24 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-aef060d9-a2f7-4cab-a9f2-c5fbd0a9cf55 tempest-GroupSnapshotsTest-511687969 None] Group tempest-GroupSnapshotsTest-Group-128141126: creating
Apr 21 02:28:24 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-aef060d9-a2f7-4cab-a9f2-c5fbd0a9cf55 tempest-GroupSnapshotsTest-511687969 None] Group tempest-GroupSnapshotsTest-Group-128141126: created successfully
Apr 21 02:28:24 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-aef060d9-a2f7-4cab-a9f2-c5fbd0a9cf55 tempest-GroupSnapshotsTest-511687969 None] Create group completed successfully.
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Flow 'volume_create_manager' (e70637b4-8e02-4d11-b34f-b5a4dd94068d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3866210c-b6a9-4134-a82d-3c6b9b944580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3866210c-b6a9-4134-a82d-3c6b9b944580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-330295960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a317ec5b-683c-4a94-9a21-996c8ce42f4a,host='devstack@QuobyteHD#QuobyteHD',id=94ee5bac-dc61-46fe-95a2-9fb9174abb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d6d558d0bf4b7a957e3889e9cdce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:28:26Z,use_quota=True,user_id='07982a1d3b2e49b3a59cc96cdc4de189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f561288c-a500-4959-b670-97d24b57c26e),volume_type_id=f561288c-a500-4959-b670-97d24b57c26e)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3882f0c6-10a8-440b-8598-cc45d2c4c189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3882f0c6-10a8-440b-8598-cc45d2c4c189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeaad1f1-3711-4fb1-9e3e-24b03361c742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeaad1f1-3711-4fb1-9e3e-24b03361c742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94ee5bac-dc61-46fe-95a2-9fb9174abb72', 'volume_name': 'volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d05b481-a44a-49dd-b7f3-2e6926f8025e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d05b481-a44a-49dd-b7f3-2e6926f8025e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a214ef0-7d99-4358-8760-33fb02e30e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:26 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Volume 94ee5bac-dc61-46fe-95a2-9fb9174abb72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72', 'volume_size': 1}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a317ec5b-683c-4a94-9a21-996c8ce42f4a,created_at=2026-04-21T00:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-330295960',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a317ec5b-683c-4a94-9a21-996c8ce42f4a,host='devstack@QuobyteHD#QuobyteHD',id=94ee5bac-dc61-46fe-95a2-9fb9174abb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d6d558d0bf4b7a957e3889e9cdce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:28:26Z,use_quota=True,user_id='07982a1d3b2e49b3a59cc96cdc4de189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f561288c-a500-4959-b670-97d24b57c26e),volume_type_id=f561288c-a500-4959-b670-97d24b57c26e)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Creating volume 94ee5bac-dc61-46fe-95a2-9fb9174abb72 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:28:26 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:28:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:26 devstack sudo[85984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 1073741824
Apr 21 02:28:26 devstack sudo[85984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:27 devstack sudo[85984]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 1073741824" returned: 0 in 1.248s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:27 devstack sudo[86016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72
Apr 21 02:28:27 devstack sudo[86016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:28 devstack sudo[86016]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72" returned: 0 in 0.898s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] <== create_volume: return (2209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:28:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.212s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a214ef0-7d99-4358-8760-33fb02e30e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b665b5-0511-47eb-9889-49d3f19f7657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:28 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Volume volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 (94ee5bac-dc61-46fe-95a2-9fb9174abb72): created successfully
Apr 21 02:28:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0b665b5-0511-47eb-9889-49d3f19f7657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Flow 'volume_create_manager' (e70637b4-8e02-4d11-b34f-b5a4dd94068d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:28:28 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-915f00a1-4d8c-4a28-835d-6385759ad9fe tempest-GroupSnapshotsTest-511687969 None] Created volume successfully.
Apr 21 02:28:29 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Flow 'volume_create_manager' (be3c9b43-d474-42e0-99fb-259175736bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caaf14ec-e290-4060-8d20-4ca31d200d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caaf14ec-e290-4060-8d20-4ca31d200d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1506613260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc6bd07-c3d3-4d87-880a-d33fdc8fec23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4348092829944ab9ababcfd3b567a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:28:30Z,use_quota=True,user_id='35f66efb00e84644b5b463a2231e766c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7f106b-86fa-4966-bed2-b65c3f655af1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d7f106b-86fa-4966-bed2-b65c3f655af1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b714bea6-b7dd-4688-901f-f204a9ad9ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b714bea6-b7dd-4688-901f-f204a9ad9ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccc6bd07-c3d3-4d87-880a-d33fdc8fec23', 'volume_name': 'volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d028dd-8c8a-43c6-9eff-205786186263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d028dd-8c8a-43c6-9eff-205786186263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd6f2cc-8e63-4b17-b9e6-c703989f4a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:30 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Volume ccc6bd07-c3d3-4d87-880a-d33fdc8fec23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23', 'volume_size': 1}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:28:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1506613260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccc6bd07-c3d3-4d87-880a-d33fdc8fec23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4348092829944ab9ababcfd3b567a402',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:28:30Z,use_quota=True,user_id='35f66efb00e84644b5b463a2231e766c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Creating volume ccc6bd07-c3d3-4d87-880a-d33fdc8fec23 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:28:30 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:30 devstack sudo[86042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23 1073741824
Apr 21 02:28:30 devstack sudo[86042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Flow 'volume_create_manager' (ab3645a1-e756-4b4b-9db2-048b159b14f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94caa624-9518-445f-b318-375b498d648f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94caa624-9518-445f-b318-375b498d648f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1179641947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a317ec5b-683c-4a94-9a21-996c8ce42f4a,host='devstack@QuobyteHD#QuobyteHD',id=fb81bdc4-addf-4333-8f57-99a1b80500ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d6d558d0bf4b7a957e3889e9cdce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:28:31Z,use_quota=True,user_id='07982a1d3b2e49b3a59cc96cdc4de189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f561288c-a500-4959-b670-97d24b57c26e),volume_type_id=f561288c-a500-4959-b670-97d24b57c26e)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4486b5-f9ad-44e6-bdaf-fd229ba4d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb4486b5-f9ad-44e6-bdaf-fd229ba4d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d115b72e-98cd-4ca5-a8b0-6208b476c84d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d115b72e-98cd-4ca5-a8b0-6208b476c84d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb81bdc4-addf-4333-8f57-99a1b80500ed', 'volume_name': 'volume-fb81bdc4-addf-4333-8f57-99a1b80500ed', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c186c1cc-b2d6-4742-a5a4-79d95ea0f0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c186c1cc-b2d6-4742-a5a4-79d95ea0f0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c190cb6-b983-4e66-9b96-f9e3ef7bbf36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:30 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Volume fb81bdc4-addf-4333-8f57-99a1b80500ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb81bdc4-addf-4333-8f57-99a1b80500ed', 'volume_size': 1}
Apr 21 02:28:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:31 devstack sudo[86042]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23 1073741824" returned: 0 in 1.714s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:32 devstack sudo[86073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23
Apr 21 02:28:32 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:32 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23" returned: 0 in 0.615s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] <== create_volume: return (2380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.389s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.717s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=a317ec5b-683c-4a94-9a21-996c8ce42f4a,created_at=2026-04-21T00:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1179641947',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=a317ec5b-683c-4a94-9a21-996c8ce42f4a,host='devstack@QuobyteHD#QuobyteHD',id=fb81bdc4-addf-4333-8f57-99a1b80500ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d6d558d0bf4b7a957e3889e9cdce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:28:31Z,use_quota=True,user_id='07982a1d3b2e49b3a59cc96cdc4de189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f561288c-a500-4959-b670-97d24b57c26e),volume_type_id=f561288c-a500-4959-b670-97d24b57c26e)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Creating volume fb81bdc4-addf-4333-8f57-99a1b80500ed {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:28:32 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd6f2cc-8e63-4b17-b9e6-c703989f4a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:32 devstack sudo[86076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed 1073741824
Apr 21 02:28:32 devstack sudo[86076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62068f9d-de5d-4dd9-a7bc-3f536429908c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:32 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Volume volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23 (ccc6bd07-c3d3-4d87-880a-d33fdc8fec23): created successfully
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62068f9d-de5d-4dd9-a7bc-3f536429908c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Flow 'volume_create_manager' (be3c9b43-d474-42e0-99fb-259175736bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:28:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ddfaf493-af9f-4e2f-992a-628b29a78efc tempest-ServerRescueNegativeTestJSON-889853985 None] Created volume successfully.
Apr 21 02:28:33 devstack sudo[86076]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed 1073741824" returned: 0 in 1.319s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:33 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=108,cinder:INSERT=37,cinder:UPDATE=124,cinder:DELETE=8 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:28:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:34 devstack sudo[86087]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed
Apr 21 02:28:34 devstack sudo[86087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:35 devstack sudo[86087]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed" returned: 0 in 1.126s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] <== create_volume: return (2503ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:28:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.509s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:35 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:UPDATE=106,cinder:SELECT=101,cinder:DELETE=8,cinder:INSERT=26 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:28:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c190cb6-b983-4e66-9b96-f9e3ef7bbf36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb81bdc4-addf-4333-8f57-99a1b80500ed', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b76f1fc-3b08-43e2-be2a-b3ae7382d076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:28:35 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Volume volume-fb81bdc4-addf-4333-8f57-99a1b80500ed (fb81bdc4-addf-4333-8f57-99a1b80500ed): created successfully
Apr 21 02:28:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b76f1fc-3b08-43e2-be2a-b3ae7382d076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:28:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Flow 'volume_create_manager' (ab3645a1-e756-4b4b-9db2-048b159b14f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:28:35 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-747553e5-e081-4ab9-9257-e72231bc9a4b tempest-GroupSnapshotsTest-511687969 None] Created volume successfully.
Apr 21 02:28:35 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-30484e45-a2e4-41f2-a9ea-ba2e16243771 tempest-GroupSnapshotsTest-511687969 None] Update group completed successfully.
Apr 21 02:28:36 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-763d458b-6479-42f0-b06d-fe14c8b06c00 tempest-GroupSnapshotsTest-511687969 None] Update group completed successfully.
Apr 21 02:28:38 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-fef469b6-7410-4805-b861-8e86751e9747 tempest-GroupSnapshotsTest-511687969 None] Update group completed successfully.
Apr 21 02:28:39 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-29bda924-6acf-4b7f-94dd-dd37e2262de7 tempest-GroupSnapshotsTest-511687969 None] Update group completed successfully.
Apr 21 02:28:40 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] GroupSnapshot 04f530d4-9322-4296-8888-47524725dd0b: creating.
Apr 21 02:28:40 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Group snapshot 04f530d4-9322-4296-8888-47524725dd0b: creating. {{(pid=82686) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 21 02:28:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Creating offline snapshot 8c49ac02-7680-4a5f-9255-34179fd74c70 of volume fb81bdc4-addf-4333-8f57-99a1b80500ed {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:28:41 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe251ec-c02b-452a-881c-4530e4b8c6ff]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:41 devstack sudo[86174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed
Apr 21 02:28:41 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:42 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed" returned: 0 in 1.381s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:42 devstack sudo[86279]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70 1G
Apr 21 02:28:42 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:44 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70 1G" returned: 0 in 1.950s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb81bdc4-addf-4333-8f57-99a1b80500ed -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:44 devstack sudo[86305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb81bdc4-addf-4333-8f57-99a1b80500ed -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70
Apr 21 02:28:44 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:46 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb81bdc4-addf-4333-8f57-99a1b80500ed -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70" returned: 0 in 2.005s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:46 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70 is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:28:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:46 devstack sudo[86317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70
Apr 21 02:28:46 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:47 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70" returned: 0 in 1.154s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:47 devstack sudo[86344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.info
Apr 21 02:28:47 devstack sudo[86344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:48 devstack sudo[86344]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.info" returned: 0 in 0.635s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:48 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:28:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:48 devstack sudo[86350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.info
Apr 21 02:28:48 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:48 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.info" returned: 0 in 0.790s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.078s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Creating offline snapshot bbca5853-2119-4dcc-9e14-70e18c45d828 of volume 94ee5bac-dc61-46fe-95a2-9fb9174abb72 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:28:49 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a38e12-5e74-466d-83de-6bf04f1917c5]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:49 devstack sudo[86382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72
Apr 21 02:28:49 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:49 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72" returned: 0 in 0.686s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:49 devstack sudo[86411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828 1G
Apr 21 02:28:49 devstack sudo[86411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:49 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-e9892ba1-c691-44a1-955e-fc56c798dbf4 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Terminate volume connection completed successfully.
Apr 21 02:28:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-e9892ba1-c691-44a1-955e-fc56c798dbf4 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Deleting attachment 17807eca-cfd6-491b-8e7a-0c8ea69aef7f. {{(pid=82686) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 21 02:28:50 devstack sudo[86411]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828 1G" returned: 0 in 0.705s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:50 devstack sudo[86418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828
Apr 21 02:28:50 devstack sudo[86418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "cinder-8c2c6971-e368-4c6b-91fc-3dc4022a9c73-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "cinder-8c2c6971-e368-4c6b-91fc-3dc4022a9c73-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "cinder-quobyte-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "cinder-quobyte-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:50 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[4771178b-c807-47bb-a415-e0cd3114472c]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:50 devstack sudo[86426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73
Apr 21 02:28:50 devstack sudo[86426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:51 devstack sudo[86418]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828" returned: 0 in 0.844s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:51 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828 is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:28:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:51 devstack sudo[86433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828
Apr 21 02:28:51 devstack sudo[86433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Acquiring lock "cinder-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:51 devstack sudo[86426]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" returned: 0 in 0.659s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Lock "cinder-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Acquiring lock "cinder-quobyte-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Lock "cinder-quobyte-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:51 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e9649-d21c-46a5-8626-b6c26e245314]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:51 devstack sudo[86436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73
Apr 21 02:28:51 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:51 devstack sudo[86437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23
Apr 21 02:28:51 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:52 devstack sudo[86433]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828" returned: 0 in 0.824s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:52 devstack sudo[86442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.info
Apr 21 02:28:52 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:52 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23" returned: 0 in 1.248s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:52 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.info" returned: 0 in 0.702s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:52 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:28:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:52 devstack sudo[86452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23
Apr 21 02:28:52 devstack sudo[86452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:52 devstack sudo[86453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.info
Apr 21 02:28:52 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:53 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" returned: 1 in 1.908s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:53 devstack sudo[86459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73
Apr 21 02:28:53 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:53 devstack sudo[86452]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23" returned: 0 in 0.915s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Lock "cinder-quobyte-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23" released by "delete_volume" :: held 2.234s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Created reservations ['abedd01a-8310-457a-ae21-991129df3abb', 'b5d9ecdf-d9a9-4acf-b5dd-f66b8df4323c', 'a83f14c8-0bd7-4f9e-ba54-923c83395d64', '14034ffb-65a8-4d4f-b29b-9d8b5a729ebf'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:28:53 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.info" returned: 0 in 1.106s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.950s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:54 devstack sudo[86465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:28:54 devstack sudo[86465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:54 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" returned: 0 in 0.876s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "cinder-quobyte-8c2c6971-e368-4c6b-91fc-3dc4022a9c73" released by "delete_volume" :: held 3.569s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:54 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f1e53901-4bd1-4b9b-9e9e-6ce4b62e39bb tempest-GroupSnapshotsTest-511687969 None] group_snapshot 04f530d4-9322-4296-8888-47524725dd0b: created successfully
Apr 21 02:28:54 devstack cinder-volume[82686]: DEBUG cinder.quota [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Created reservations ['a50aafc2-db7f-4604-8ed9-52ce6d912b57', 'b945bbad-a2a0-4cc9-b45c-b60a0c71b5db', '1c6bbd32-5dc5-4425-b59a-fc7bf8ce1496', '07f7d9aa-b765-4e1d-a034-a4ed23c71e11'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:28:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:28:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:28:54 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:28:54 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:28:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:28:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:54 devstack sudo[86467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:28:54 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:54 devstack sudo[86465]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 1.020s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:54 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:28:55 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Deleted volume successfully.
Apr 21 02:28:55 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] group_snapshot 04f530d4-9322-4296-8888-47524725dd0b: deleting
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] group_snapshot 04f530d4-9322-4296-8888-47524725dd0b: deleting {{(pid=82686) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9b9d4c51-ca1e-44c7-b7df-b5a07d8635af tempest-ServerRescueNegativeTestJSON-889853985 None] Lock "cinder-ccc6bd07-c3d3-4d87-880a-d33fdc8fec23-delete_volume" released by "delete_volume" :: held 3.884s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-fb81bdc4-addf-4333-8f57-99a1b80500ed" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-fb81bdc4-addf-4333-8f57-99a1b80500ed" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-8c49ac02-7680-4a5f-9255-34179fd74c70" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-8c49ac02-7680-4a5f-9255-34179fd74c70" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Deleting offline snapshot 8c49ac02-7680-4a5f-9255-34179fd74c70 of volume fb81bdc4-addf-4333-8f57-99a1b80500ed {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] snapshot_file for this snap is: volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb116581-8dd2-4631-8fa6-2af488b52842]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:55 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 1.126s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG cinder.manager [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:28:55 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Deleted volume successfully.
Apr 21 02:28:55 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-772cc6c9-9cf8-476a-b9e4-a480315b157a req-1035a016-7a69-477f-b591-dffce16d3634 tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "cinder-8c2c6971-e368-4c6b-91fc-3dc4022a9c73-delete_volume" released by "delete_volume" :: held 4.961s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:55 devstack sudo[86474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70
Apr 21 02:28:55 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:56 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70" returned: 0 in 1.117s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb81bdc4-addf-4333-8f57-99a1b80500ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:28:56 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad3da2a-0c50-4316-8bc8-9329bb8c65ac]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:56 devstack sudo[86522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed
Apr 21 02:28:56 devstack sudo[86522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:57 devstack sudo[86522]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed" returned: 0 in 0.858s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:57 devstack sudo[86564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70
Apr 21 02:28:57 devstack sudo[86564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:58 devstack sudo[86564]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70" returned: 0 in 0.686s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:58 devstack sudo[86594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70
Apr 21 02:28:58 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:58 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed.8c49ac02-7680-4a5f-9255-34179fd74c70" returned: 0 in 0.522s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-8c49ac02-7680-4a5f-9255-34179fd74c70" released by "_delete_snapshot" :: held 3.271s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-fb81bdc4-addf-4333-8f57-99a1b80500ed" released by "delete_snapshot" :: held 3.318s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-94ee5bac-dc61-46fe-95a2-9fb9174abb72" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-94ee5bac-dc61-46fe-95a2-9fb9174abb72" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-bbca5853-2119-4dcc-9e14-70e18c45d828" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-bbca5853-2119-4dcc-9e14-70e18c45d828" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Deleting offline snapshot bbca5853-2119-4dcc-9e14-70e18c45d828 of volume 94ee5bac-dc61-46fe-95a2-9fb9174abb72 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] snapshot_file for this snap is: volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5ae166-2fbf-4b98-8c10-414fd52356c3]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:58 devstack sudo[86599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828
Apr 21 02:28:58 devstack sudo[86599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:59 devstack sudo[86599]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828" returned: 0 in 0.521s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:28:59 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abfcf91-f371-44ff-be24-4e288b369a95]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:28:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:59 devstack sudo[86606]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72
Apr 21 02:28:59 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:28:59 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root
Apr 21 02:28:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72" returned: 0 in 0.690s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:28:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:28:59 devstack sudo[86614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828
Apr 21 02:28:59 devstack sudo[86614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:00 devstack sudo[86614]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828" returned: 0 in 0.523s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:00 devstack sudo[86620]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828
Apr 21 02:29:00 devstack sudo[86620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:00 devstack sudo[86620]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72.bbca5853-2119-4dcc-9e14-70e18c45d828" returned: 0 in 0.488s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-bbca5853-2119-4dcc-9e14-70e18c45d828" released by "_delete_snapshot" :: held 2.288s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-94ee5bac-dc61-46fe-95a2-9fb9174abb72" released by "delete_snapshot" :: held 2.301s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:01 devstack cinder-volume[82686]: WARNING cinder.quota [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1115010106 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1115010106, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:01 devstack cinder-volume[82686]: WARNING cinder.quota [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1115010106 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1115010106, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:01 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Created reservations ['f7e67b0d-7280-4f85-8354-6230c596d6dd', '2e547d3f-1bfc-472d-9d6b-5ddb071f5860', '2edc20ed-4a9d-44e9-9eaa-d92a5e89fb0c', 'e8ec746a-f906-4747-b0b8-c27841555f8d'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:01 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] Created reservations ['1f53e058-0cbd-4d94-8d4e-f132ef312b5f', '8ba3e217-e124-4888-9cdf-ec1e05bfc447', 'd6789675-667c-4787-8f90-9f6410b53627', 'd9ba4680-40f9-4729-92f5-81378c70c609'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:01 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-870af191-de21-4736-9ccb-f73a2a95e981 tempest-GroupSnapshotsTest-511687969 None] group_snapshot 04f530d4-9322-4296-8888-47524725dd0b: deleted successfully
Apr 21 02:29:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-94ee5bac-dc61-46fe-95a2-9fb9174abb72" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-94ee5bac-dc61-46fe-95a2-9fb9174abb72" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a06c82-351d-47f0-9719-b379f7e082d8]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:02 devstack sudo[86651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72
Apr 21 02:29:02 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:02 devstack cinder-volume[82686]: DEBUG oslo_service.periodic_task [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82686) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:29:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:02 devstack sudo[86658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:02 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:03 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72" returned: 0 in 0.997s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:03 devstack sudo[86667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72
Apr 21 02:29:03 devstack sudo[86667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:04 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 1.066s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:04 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:04 devstack sudo[86667]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-94ee5bac-dc61-46fe-95a2-9fb9174abb72" returned: 0 in 0.854s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-94ee5bac-dc61-46fe-95a2-9fb9174abb72" released by "delete_volume" :: held 1.956s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-fb81bdc4-addf-4333-8f57-99a1b80500ed" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-fb81bdc4-addf-4333-8f57-99a1b80500ed" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:04 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6c1817-846d-4295-bca7-95aa89958049]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:04 devstack sudo[86707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed
Apr 21 02:29:04 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:04 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed" returned: 0 in 0.690s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:04 devstack sudo[86716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed
Apr 21 02:29:04 devstack sudo[86716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (6467856e-96f1-4b1e-bcbd-09c97df35cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a5dbce-1e47-4248-b4da-855484d4df48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a5dbce-1e47-4248-b4da-855484d4df48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-378527241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb23cd4-922c-4082-bd9b-cec2f6e42b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:05Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f4a2a5-62af-4e3c-9d66-592d7c31ccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55f4a2a5-62af-4e3c-9d66-592d7c31ccba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c57386-93f6-4edd-8d8b-51d14e441708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c57386-93f6-4edd-8d8b-51d14e441708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbb23cd4-922c-4082-bd9b-cec2f6e42b03', 'volume_name': 'volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa9ac91-9a4b-46e6-85fe-f8b9daec90e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fa9ac91-9a4b-46e6-85fe-f8b9daec90e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6e3c79-3df7-4cd2-b3b2-e9bfb8c4cef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:05 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Volume bbb23cd4-922c-4082-bd9b-cec2f6e42b03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03', 'volume_size': 1}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-378527241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb23cd4-922c-4082-bd9b-cec2f6e42b03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:05Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Creating volume bbb23cd4-922c-4082-bd9b-cec2f6e42b03 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:05 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:05 devstack sudo[86720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03 1073741824
Apr 21 02:29:05 devstack sudo[86720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:05 devstack sudo[86716]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fb81bdc4-addf-4333-8f57-99a1b80500ed" returned: 0 in 0.572s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-fb81bdc4-addf-4333-8f57-99a1b80500ed" released by "delete_volume" :: held 1.330s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Created reservations ['b02d7409-2ea4-435a-8d1e-7ba5d6b63012'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:05 devstack cinder-volume[82686]: WARNING cinder.quota [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1115010106 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1115010106, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Created reservations ['d9bd60b6-c10a-43f8-bbd7-efc664332a9f', '438d473f-dfe0-4c2c-b1f7-28d920df5ff1', 'a97484ad-4a6f-411c-9e39-868703208856', 'e82aa317-baec-4f19-83b5-2724cead6a49'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Created reservations ['99e16922-385e-40c4-b8bc-26e9dafebce9', 'c381139c-0012-4f4b-ad3b-81927867a79e', '31e4b6b9-0901-417d-8d2b-cea6a1f06739', 'e633d0fa-bf5e-4c13-a10d-dce37d44cc14'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:05 devstack sudo[86726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:05 devstack sudo[86726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:06 devstack sudo[86720]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03 1073741824" returned: 0 in 0.644s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:06 devstack sudo[86728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03
Apr 21 02:29:06 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:06 devstack sudo[86726]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.437s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:06 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-0c4883a3-1cb9-463f-b3a2-d89244df4f96 tempest-GroupSnapshotsTest-511687969 None] Delete group completed successfully.
Apr 21 02:29:06 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03" returned: 0 in 0.460s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef6e3c79-3df7-4cd2-b3b2-e9bfb8c4cef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ca4844-ca93-4f09-9a4f-eb780712d5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:06 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Volume volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03 (bbb23cd4-922c-4082-bd9b-cec2f6e42b03): created successfully
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ca4844-ca93-4f09-9a4f-eb780712d5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (6467856e-96f1-4b1e-bcbd-09c97df35cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:06 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-dc795e69-ccd8-4a0f-a2f5-71d833c4b6ee tempest-VolumesActionsTest-775681778 None] Created volume successfully.
Apr 21 02:29:06 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-661bff9c-bb50-4af3-8ed6-6dd835bd21cc tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Terminate volume connection completed successfully.
Apr 21 02:29:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-661bff9c-bb50-4af3-8ed6-6dd835bd21cc tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Deleting attachment 7ba89c49-373b-4421-997c-f7480b8a3371. {{(pid=82686) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Apr 21 02:29:07 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f138c83a-e8e8-4a95-a179-79b6057d251f tempest-GroupSnapshotsTest-511687969 None] Group tempest-GroupSnapshotsTest-Group-1738020675: creating
Apr 21 02:29:07 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f138c83a-e8e8-4a95-a179-79b6057d251f tempest-GroupSnapshotsTest-511687969 None] Group tempest-GroupSnapshotsTest-Group-1738020675: created successfully
Apr 21 02:29:07 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f138c83a-e8e8-4a95-a179-79b6057d251f tempest-GroupSnapshotsTest-511687969 None] Create group completed successfully.
Apr 21 02:29:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "cinder-22930ece-a42f-4661-977a-788270ce1121-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "cinder-22930ece-a42f-4661-977a-788270ce1121-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "cinder-quobyte-22930ece-a42f-4661-977a-788270ce1121" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "cinder-quobyte-22930ece-a42f-4661-977a-788270ce1121" acquired by "delete_volume" :: waited 0.017s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5d35efbc-1cc5-45e3-83a3-c8bd53ae5e3a tempest-VolumesActionsTest-775681778 None] Acquiring lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03" by "attach_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:07 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[497724f4-95bc-45a1-b595-c48a6aa98530]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5d35efbc-1cc5-45e3-83a3-c8bd53ae5e3a tempest-VolumesActionsTest-775681778 None] Lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03" acquired by "attach_volume" :: waited 0.038s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:07 devstack sudo[86732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121
Apr 21 02:29:07 devstack sudo[86732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:07 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-5d35efbc-1cc5-45e3-83a3-c8bd53ae5e3a tempest-VolumesActionsTest-775681778 None] Attaching volume bbb23cd4-922c-4082-bd9b-cec2f6e42b03 to instance 6d70c6d5-f5b9-4433-b9f3-adc45e6b5350 at mountpoint /dev/vdb on host None.
Apr 21 02:29:07 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-5d35efbc-1cc5-45e3-83a3-c8bd53ae5e3a tempest-VolumesActionsTest-775681778 None] Attach volume completed successfully.
Apr 21 02:29:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5d35efbc-1cc5-45e3-83a3-c8bd53ae5e3a tempest-VolumesActionsTest-775681778 None] Lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03" released by "attach_volume" :: held 0.100s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:07 devstack sudo[86732]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121" returned: 0 in 0.506s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:07 devstack sudo[86737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121
Apr 21 02:29:07 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Flow 'volume_create_manager' (3fc22c74-6343-49fe-814c-e58b14907825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f645fd1-680c-4283-bf53-257b953e06b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:08 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f645fd1-680c-4283-bf53-257b953e06b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-127114253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9b04dfe6-afa5-468f-82f4-ebeea6b66aa4,host='devstack@QuobyteHD#QuobyteHD',id=9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d6d558d0bf4b7a957e3889e9cdce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:08Z,use_quota=True,user_id='07982a1d3b2e49b3a59cc96cdc4de189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f151d41-7848-469f-ae76-30135c6776e0),volume_type_id=1f151d41-7848-469f-ae76-30135c6776e0)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767e44f1-ae9f-4fb1-abe8-0dcc8b77bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (767e44f1-ae9f-4fb1-abe8-0dcc8b77bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b051e9-c9b1-456d-bb75-28e6a16effc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13b051e9-c9b1-456d-bb75-28e6a16effc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3', 'volume_name': 'volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504e660d-bfe1-40b2-8276-dc9c4be71467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (504e660d-bfe1-40b2-8276-dc9c4be71467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdaf445e-f832-4e01-8f5e-685c898037e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:08 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Volume 9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3', 'volume_size': 1}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=9b04dfe6-afa5-468f-82f4-ebeea6b66aa4,created_at=2026-04-21T00:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-127114253',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=9b04dfe6-afa5-468f-82f4-ebeea6b66aa4,host='devstack@QuobyteHD#QuobyteHD',id=9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5d6d558d0bf4b7a957e3889e9cdce6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:08Z,use_quota=True,user_id='07982a1d3b2e49b3a59cc96cdc4de189',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f151d41-7848-469f-ae76-30135c6776e0),volume_type_id=1f151d41-7848-469f-ae76-30135c6776e0)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Creating volume 9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:08 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:08 devstack sudo[86740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 1073741824
Apr 21 02:29:08 devstack sudo[86740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22930ece-a42f-4661-977a-788270ce1121" returned: 0 in 0.669s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:08 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-872a8ebd-0918-4ccb-ab6c-4d37ce701c4e tempest-VolumesActionsTest-819050836 None] Terminate volume connection completed successfully.
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "cinder-quobyte-22930ece-a42f-4661-977a-788270ce1121" released by "delete_volume" :: held 1.233s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.quota [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Created reservations ['bdbf4969-6c38-43db-893b-af58ec73b332', 'dce640c6-dcbe-47f6-9ed6-3aff86129950', 'ebb3517a-6ea7-4420-a47b-c6b9d17b8eed', '77807dc1-cc5b-4e07-b746-a75d22c4cda7'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:08 devstack sudo[86742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:08 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-872a8ebd-0918-4ccb-ab6c-4d37ce701c4e tempest-VolumesActionsTest-819050836 None] Acquiring lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03-detach_volume" by "detach_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-872a8ebd-0918-4ccb-ab6c-4d37ce701c4e tempest-VolumesActionsTest-819050836 None] Lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:09 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-872a8ebd-0918-4ccb-ab6c-4d37ce701c4e tempest-VolumesActionsTest-819050836 None] Detaching volume bbb23cd4-922c-4082-bd9b-cec2f6e42b03 from instance 6d70c6d5-f5b9-4433-b9f3-adc45e6b5350.
Apr 21 02:29:09 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-872a8ebd-0918-4ccb-ab6c-4d37ce701c4e tempest-VolumesActionsTest-819050836 None] Detach volume completed successfully.
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-872a8ebd-0918-4ccb-ab6c-4d37ce701c4e tempest-VolumesActionsTest-819050836 None] Lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:09 devstack sudo[86740]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 1073741824" returned: 0 in 0.649s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:09 devstack sudo[86747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3
Apr 21 02:29:09 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:09 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.706s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.manager [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:09 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Deleted volume successfully.
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-93f163e4-b4b3-47cd-98bb-5b114f74cbbe req-6421362b-bd3d-411a-9c7c-cd928e87a05c tempest-ServerBootFromVolumeStableRescueTest-1436243873 None] Lock "cinder-22930ece-a42f-4661-977a-788270ce1121-delete_volume" released by "delete_volume" :: held 2.119s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a8ff4670-d74b-40d3-a112-f9d3f2a56b9c tempest-VolumesActionsTest-775681778 None] Acquiring lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03-detach_volume" by "detach_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a8ff4670-d74b-40d3-a112-f9d3f2a56b9c tempest-VolumesActionsTest-775681778 None] Lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:09 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-a8ff4670-d74b-40d3-a112-f9d3f2a56b9c tempest-VolumesActionsTest-775681778 None] Volume detach called, but volume not attached.
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a8ff4670-d74b-40d3-a112-f9d3f2a56b9c tempest-VolumesActionsTest-775681778 None] Lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03-detach_volume" released by "detach_volume" :: held 0.014s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:09 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3" returned: 0 in 0.616s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdaf445e-f832-4e01-8f5e-685c898037e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd71b74-9138-45a0-8b09-81336d5a4cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:09 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Volume volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 (9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3): created successfully
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fd71b74-9138-45a0-8b09-81336d5a4cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Flow 'volume_create_manager' (3fc22c74-6343-49fe-814c-e58b14907825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:09 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-37318814-828f-4afd-ab7c-5b5172ec2613 tempest-GroupSnapshotsTest-511687969 None] Created volume successfully.
Apr 21 02:29:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Acquiring lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Acquiring lock "cinder-quobyte-bbb23cd4-922c-4082-bd9b-cec2f6e42b03" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Lock "cinder-quobyte-bbb23cd4-922c-4082-bd9b-cec2f6e42b03" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:10 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[70df6473-ae34-4d8f-9f13-cee353b8ee8a]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:10 devstack sudo[86752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03
Apr 21 02:29:10 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:11 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] GroupSnapshot f65cad21-d6d2-45e1-9e6b-405942bc6c12: creating.
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] Group snapshot f65cad21-d6d2-45e1-9e6b-405942bc6c12: creating. {{(pid=82686) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.008s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] Creating offline snapshot 88470f2a-0240-45eb-9dbb-83689900dd95 of volume 9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5283193-dca3-447e-839c-b1279f1a0f1c]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:11 devstack sudo[86755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3
Apr 21 02:29:11 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:11 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03" returned: 0 in 0.803s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:11 devstack sudo[86761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03
Apr 21 02:29:11 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:11 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3" returned: 0 in 0.706s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:11 devstack sudo[86768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95 1G
Apr 21 02:29:11 devstack sudo[86768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:11 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bbb23cd4-922c-4082-bd9b-cec2f6e42b03" returned: 0 in 0.512s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Lock "cinder-quobyte-bbb23cd4-922c-4082-bd9b-cec2f6e42b03" released by "delete_volume" :: held 1.363s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:11 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Created reservations ['18e94232-fd48-4da4-b534-dfaa45d28b97', '15b3cb52-7d85-40d1-9346-01f53967cfa1', '9811de21-63a9-4737-af26-43b78675599b', '76bfd4cd-0b76-42ec-909b-9ae50936f550'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:12 devstack sudo[86772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:12 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:12 devstack sudo[86768]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95 1G" returned: 0 in 0.745s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:12 devstack sudo[86801]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95
Apr 21 02:29:12 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:12 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.921s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:12 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:12 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Deleted volume successfully.
Apr 21 02:29:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-672bd1aa-ef05-481f-98e6-7503f7ec2f82 tempest-VolumesActionsTest-775681778 None] Lock "cinder-bbb23cd4-922c-4082-bd9b-cec2f6e42b03-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:13 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95" returned: 0 in 0.809s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:13 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95 is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:29:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:13 devstack sudo[86810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95
Apr 21 02:29:13 devstack sudo[86810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:14 devstack sudo[86810]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95" returned: 0 in 0.590s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:14 devstack sudo[86820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.info
Apr 21 02:29:14 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:14 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.info" returned: 0 in 0.705s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:14 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:29:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:14 devstack sudo[86840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.info
Apr 21 02:29:14 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:15 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.info" returned: 0 in 0.471s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.108s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:15 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6d5e5725-ee6b-45cb-b3ba-4a8b7f458613 tempest-GroupSnapshotsTest-511687969 None] group_snapshot f65cad21-d6d2-45e1-9e6b-405942bc6c12: created successfully
Apr 21 02:29:16 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] group_snapshot f65cad21-d6d2-45e1-9e6b-405942bc6c12: deleting
Apr 21 02:29:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] group_snapshot f65cad21-d6d2-45e1-9e6b-405942bc6c12: deleting {{(pid=82686) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Apr 21 02:29:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-88470f2a-0240-45eb-9dbb-83689900dd95" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-88470f2a-0240-45eb-9dbb-83689900dd95" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Deleting offline snapshot 88470f2a-0240-45eb-9dbb-83689900dd95 of volume 9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:29:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] snapshot_file for this snap is: volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:29:16 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b8570c-ea82-4f71-aa26-f64d4cd664f2]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:16 devstack sudo[86845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95
Apr 21 02:29:16 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:17 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95" returned: 0 in 0.530s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:29:17 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[844a817c-2333-4733-8ef9-1fc0f5bd2dcc]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:17 devstack sudo[86850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3
Apr 21 02:29:17 devstack sudo[86850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:17 devstack sudo[86850]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3" returned: 0 in 0.510s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:17 devstack sudo[86855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95
Apr 21 02:29:17 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-71dffd8a-a24e-4549-9be1-79f113cd39bf tempest-BackendsCapabilitiesAdminTestsJSON-2122284738 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82686) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 21 02:29:18 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95" returned: 0 in 0.480s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:18 devstack sudo[86860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95
Apr 21 02:29:18 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-018c1412-c850-4f4e-817c-0ff3da9167d5 tempest-BackendsCapabilitiesAdminTestsJSON-2122284738 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.732795715332, 'free_capacity_gb': 1775.732795715332, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82686) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Apr 21 02:29:18 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3.88470f2a-0240-45eb-9dbb-83689900dd95" returned: 0 in 0.442s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-88470f2a-0240-45eb-9dbb-83689900dd95" released by "_delete_snapshot" :: held 2.018s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3" released by "delete_snapshot" :: held 2.040s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:18 devstack cinder-volume[82686]: WARNING cinder.quota [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-927891238 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-927891238, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:18 devstack cinder-volume[82686]: WARNING cinder.quota [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-927891238 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-927891238, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:18 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] Created reservations ['84e2de91-f15e-458e-a1d0-fac53a2ef949', '681959ad-52c4-4fa6-935c-559db723a7de', 'bbdc3d69-7586-446d-8fd9-175be0b651cb', '6b0a473c-ee45-4ab2-96f5-dc7ae609e083'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:18 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-688cdcad-6e5c-4376-8176-ca421f315f5d tempest-GroupSnapshotsTest-511687969 None] group_snapshot f65cad21-d6d2-45e1-9e6b-405942bc6c12: deleted successfully
Apr 21 02:29:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "cinder-quobyte-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:18 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4f0b7f-7d09-469a-9148-f2708b5d68a3]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:18 devstack sudo[86864]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3
Apr 21 02:29:18 devstack sudo[86864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (2a93ca50-706f-45d5-8194-675d1ddd1e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6940d66-2cc5-49e6-8932-d2c6de9e03f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6940d66-2cc5-49e6-8932-d2c6de9e03f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-857406421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19cfe44-f667-402f-bed9-162d4f883469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:19Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b28df0-7cfc-4b57-848b-50a084b20559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b28df0-7cfc-4b57-848b-50a084b20559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df15b882-03cb-4e31-a60e-99d7ff355208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df15b882-03cb-4e31-a60e-99d7ff355208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e19cfe44-f667-402f-bed9-162d4f883469', 'volume_name': 'volume-e19cfe44-f667-402f-bed9-162d4f883469', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584cbf86-6e83-4473-9d45-8b93a802563a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (584cbf86-6e83-4473-9d45-8b93a802563a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be27eea6-6106-4d2a-9137-5bdd47e1d7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:19 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Volume e19cfe44-f667-402f-bed9-162d4f883469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e19cfe44-f667-402f-bed9-162d4f883469', 'volume_size': 1}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-857406421',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e19cfe44-f667-402f-bed9-162d4f883469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:19Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Creating volume e19cfe44-f667-402f-bed9-162d4f883469 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:19 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:19 devstack sudo[86866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469 1073741824
Apr 21 02:29:19 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:19 devstack sudo[86864]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3" returned: 0 in 0.742s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:19 devstack sudo[86871]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3
Apr 21 02:29:19 devstack sudo[86871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:20 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469 1073741824" returned: 0 in 0.661s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:20 devstack sudo[86878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469
Apr 21 02:29:20 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:20 devstack sudo[86871]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3" returned: 0 in 0.570s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Lock "cinder-quobyte-9fb759bb-9d2d-4a5f-a7c8-cb9f3501bac3" released by "delete_volume" :: held 1.348s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Created reservations ['3ab4d27d-75eb-4fae-bd9d-d44fff426d9a'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:20 devstack cinder-volume[82686]: WARNING cinder.quota [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-927891238 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-927891238, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Created reservations ['3301a9ce-a624-4b7d-8004-e2a2d027ebec', '6662789b-d43d-4ce8-b6d7-63391bf3767e', '7ba029c9-cfcb-4460-af2f-8fb10080f04a', '0d981d13-37ae-44cc-bc02-4b0a4ea83e6d'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:20 devstack sudo[86880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:20 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:20 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469" returned: 0 in 0.479s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.192s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be27eea6-6106-4d2a-9137-5bdd47e1d7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e19cfe44-f667-402f-bed9-162d4f883469', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a495e3-b0ad-4f27-b32a-a24e0c978043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:20 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Volume volume-e19cfe44-f667-402f-bed9-162d4f883469 (e19cfe44-f667-402f-bed9-162d4f883469): created successfully
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a495e3-b0ad-4f27-b32a-a24e0c978043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (2a93ca50-706f-45d5-8194-675d1ddd1e0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:20 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-65b8c407-08fe-4088-b75b-e6216f135bf1 tempest-VolumesActionsTest-775681778 None] Created volume successfully.
Apr 21 02:29:20 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.494s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:20 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:20 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ddcbec83-3057-4192-82be-45dde072ac56 tempest-GroupSnapshotsTest-511687969 None] Delete group completed successfully.
Apr 21 02:29:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Acquiring lock "cinder-e19cfe44-f667-402f-bed9-162d4f883469-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Lock "cinder-e19cfe44-f667-402f-bed9-162d4f883469-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Acquiring lock "cinder-quobyte-e19cfe44-f667-402f-bed9-162d4f883469" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Lock "cinder-quobyte-e19cfe44-f667-402f-bed9-162d4f883469" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:21 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[5271fae0-2642-4959-9d7e-45ecf566a78d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:21 devstack sudo[86885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469
Apr 21 02:29:21 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:22 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469" returned: 0 in 0.569s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:22 devstack sudo[86890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469
Apr 21 02:29:22 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Flow 'volume_create_manager' (0795c51a-7aad-4ba6-a542-9cc7512987c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e4bfb4-5853-4d33-8068-4e841b01e24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e4bfb4-5853-4d33-8068-4e841b01e24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1613353924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607ce390-2baf-49fe-9b95-d9bfdc008bd5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='efdea36db6bc4d0eb26f147ddeb7b0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:22Z,use_quota=True,user_id='15a8570f8fe94da887d82a624752ee6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791fdc81-06fb-4ce8-9a7f-8b771e317f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (791fdc81-06fb-4ce8-9a7f-8b771e317f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4f8355-72fd-4493-bb93-55d81d0fcdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d4f8355-72fd-4493-bb93-55d81d0fcdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '607ce390-2baf-49fe-9b95-d9bfdc008bd5', 'volume_name': 'volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978b7e78-8dbb-4a9f-81e3-8988aaf977df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978b7e78-8dbb-4a9f-81e3-8988aaf977df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ffdc2d-1220-4f7c-9779-a4ab42082a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:22 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Volume 607ce390-2baf-49fe-9b95-d9bfdc008bd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5', 'volume_size': 1}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1613353924',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=607ce390-2baf-49fe-9b95-d9bfdc008bd5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='efdea36db6bc4d0eb26f147ddeb7b0b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:22Z,use_quota=True,user_id='15a8570f8fe94da887d82a624752ee6a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Creating volume 607ce390-2baf-49fe-9b95-d9bfdc008bd5 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:22 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:22 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-13ebb43f-dd55-4b13-8d59-7a5b4bb2cac8 tempest-GroupsV320Test-1959008325 None] Group tempest-GroupsV320Test-Group-1583358744: creating
Apr 21 02:29:22 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-13ebb43f-dd55-4b13-8d59-7a5b4bb2cac8 tempest-GroupsV320Test-1959008325 None] Group tempest-GroupsV320Test-Group-1583358744: created successfully
Apr 21 02:29:22 devstack sudo[86892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5 1073741824
Apr 21 02:29:22 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:22 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-13ebb43f-dd55-4b13-8d59-7a5b4bb2cac8 tempest-GroupsV320Test-1959008325 None] Create group completed successfully.
Apr 21 02:29:22 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e19cfe44-f667-402f-bed9-162d4f883469" returned: 0 in 0.571s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Lock "cinder-quobyte-e19cfe44-f667-402f-bed9-162d4f883469" released by "delete_volume" :: held 1.169s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Created reservations ['3e054c22-546e-424a-b6fe-e4a9f4ef7bf3', '2dad1959-9f6b-48e2-a669-a6651e5cba92', '21476ddd-5389-471d-91bb-69fb4902ed2a', '8f8273c9-45b3-4342-abc2-6f2b3a94f2af'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:22 devstack sudo[86895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:22 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:23 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5 1073741824" returned: 0 in 0.593s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:23 devstack sudo[86900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5
Apr 21 02:29:23 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:23 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.467s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:23 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Deleted volume successfully.
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6befc05f-5515-444a-b1ac-bf948e9e1cc8 tempest-VolumesActionsTest-819050836 None] Lock "cinder-e19cfe44-f667-402f-bed9-162d4f883469-delete_volume" released by "delete_volume" :: held 1.773s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:23 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5" returned: 0 in 0.433s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8ffdc2d-1220-4f7c-9779-a4ab42082a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c38b22e-d563-412a-80a5-eacd5b2d8369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:23 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Volume volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5 (607ce390-2baf-49fe-9b95-d9bfdc008bd5): created successfully
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c38b22e-d563-412a-80a5-eacd5b2d8369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Flow 'volume_create_manager' (0795c51a-7aad-4ba6-a542-9cc7512987c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:23 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-ba24515d-8c97-400c-87a8-4c12807a5ab2 req-14ecde2e-36c4-43c0-a601-6e4ab73a03b1 tempest-VolumesGetTestJSON-1690903104 None] Created volume successfully.
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (9e089ded-2e1d-4ca2-9077-8374e1de441f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3cdea6-dc9c-47a0-8304-ea369a6d274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb3cdea6-dc9c-47a0-8304-ea369a6d274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1902707154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52569f3d-6b95-409c-9b88-09be6253003e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:24Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c7ddaf-19f1-4a10-951c-cbca7813ee75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c7ddaf-19f1-4a10-951c-cbca7813ee75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983bb4d1-b541-47f1-81de-51b3a4ba3bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983bb4d1-b541-47f1-81de-51b3a4ba3bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52569f3d-6b95-409c-9b88-09be6253003e', 'volume_name': 'volume-52569f3d-6b95-409c-9b88-09be6253003e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032eea10-1427-4b47-b089-bf53823f9026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (032eea10-1427-4b47-b089-bf53823f9026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2cb9d4-094c-4beb-bda0-d6d0b917add5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:24 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Volume 52569f3d-6b95-409c-9b88-09be6253003e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52569f3d-6b95-409c-9b88-09be6253003e', 'volume_size': 1}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1902707154',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52569f3d-6b95-409c-9b88-09be6253003e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:24Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Creating volume 52569f3d-6b95-409c-9b88-09be6253003e {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:24 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-50179730-7991-4619-a540-17d83869a226 tempest-GroupsV320Test-1959008325 None] Created reservations ['733c2b3c-516a-4541-890d-14f126a9924b'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:24 devstack sudo[86905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e 1073741824
Apr 21 02:29:24 devstack sudo[86905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-50179730-7991-4619-a540-17d83869a226 tempest-GroupsV320Test-1959008325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-50179730-7991-4619-a540-17d83869a226 tempest-GroupsV320Test-1959008325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-50179730-7991-4619-a540-17d83869a226 tempest-GroupsV320Test-1959008325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-50179730-7991-4619-a540-17d83869a226 tempest-GroupsV320Test-1959008325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-50179730-7991-4619-a540-17d83869a226 tempest-GroupsV320Test-1959008325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-50179730-7991-4619-a540-17d83869a226 tempest-GroupsV320Test-1959008325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:24 devstack sudo[86907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:24 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:24 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-50179730-7991-4619-a540-17d83869a226 tempest-GroupsV320Test-1959008325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.467s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-50179730-7991-4619-a540-17d83869a226 tempest-GroupsV320Test-1959008325 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:24 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-50179730-7991-4619-a540-17d83869a226 tempest-GroupsV320Test-1959008325 None] Delete group completed successfully.
Apr 21 02:29:24 devstack sudo[86905]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e 1073741824" returned: 0 in 0.601s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:24 devstack sudo[86913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e
Apr 21 02:29:24 devstack sudo[86913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Acquiring lock "cinder-607ce390-2baf-49fe-9b95-d9bfdc008bd5-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Lock "cinder-607ce390-2baf-49fe-9b95-d9bfdc008bd5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Acquiring lock "cinder-quobyte-607ce390-2baf-49fe-9b95-d9bfdc008bd5" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Lock "cinder-quobyte-607ce390-2baf-49fe-9b95-d9bfdc008bd5" acquired by "delete_volume" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9ade1b-b148-407a-81d2-92599b87f9c3]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:25 devstack sudo[86915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5
Apr 21 02:29:25 devstack sudo[86915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:25 devstack sudo[86913]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e" returned: 0 in 0.538s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2cb9d4-094c-4beb-bda0-d6d0b917add5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52569f3d-6b95-409c-9b88-09be6253003e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c0fbf5-a6ef-4f1f-b20c-8514047272e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:25 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Volume volume-52569f3d-6b95-409c-9b88-09be6253003e (52569f3d-6b95-409c-9b88-09be6253003e): created successfully
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c0fbf5-a6ef-4f1f-b20c-8514047272e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (9e089ded-2e1d-4ca2-9077-8374e1de441f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:25 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-44ed95ab-fbe0-4cf1-b580-0f1aa56124a0 tempest-VolumesActionsTest-775681778 None] Created volume successfully.
Apr 21 02:29:25 devstack sudo[86915]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5" returned: 0 in 0.559s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:25 devstack sudo[86921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5
Apr 21 02:29:25 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:26 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-607ce390-2baf-49fe-9b95-d9bfdc008bd5" returned: 0 in 0.610s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Lock "cinder-quobyte-607ce390-2baf-49fe-9b95-d9bfdc008bd5" released by "delete_volume" :: held 1.199s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG cinder.quota [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Created reservations ['86f9cd20-4489-40d6-a85c-b3fb3664e1f4', '26923291-b5d4-46bb-9dc9-fa5acab7e4b1', 'b2d521c9-1dcd-4d4d-b083-3c2857e43c9e', 'd04255c2-ba51-40a1-94d5-5aafc0d2bbda'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:26 devstack sudo[86924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:26 devstack sudo[86924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Acquiring lock "cinder-52569f3d-6b95-409c-9b88-09be6253003e-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Lock "cinder-52569f3d-6b95-409c-9b88-09be6253003e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Acquiring lock "cinder-quobyte-52569f3d-6b95-409c-9b88-09be6253003e" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Lock "cinder-quobyte-52569f3d-6b95-409c-9b88-09be6253003e" acquired by "delete_volume" :: waited 0.020s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfc7d7d-e039-4236-8b59-32b8c8a515d7]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:26 devstack sudo[86926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e
Apr 21 02:29:26 devstack sudo[86926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:26 devstack sudo[86924]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.538s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG cinder.manager [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:26 devstack cinder-volume[82686]: INFO cinder.volume.manager [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Deleted volume successfully.
Apr 21 02:29:26 devstack cinder-volume[82686]: DEBUG cinder.coordination [req-dc18dc3a-4f75-4a3d-97e3-635f86015b4d req-c76bb50b-bb29-4170-810e-d08783315962 tempest-VolumesGetTestJSON-1690903104 None] Lock "cinder-607ce390-2baf-49fe-9b95-d9bfdc008bd5-delete_volume" released by "delete_volume" :: held 1.862s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:27 devstack sudo[86926]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e" returned: 0 in 0.645s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:27 devstack sudo[86932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e
Apr 21 02:29:27 devstack sudo[86932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:27 devstack sudo[86932]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-52569f3d-6b95-409c-9b88-09be6253003e" returned: 0 in 0.484s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Lock "cinder-quobyte-52569f3d-6b95-409c-9b88-09be6253003e" released by "delete_volume" :: held 1.152s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:27 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Created reservations ['22372901-3e67-4317-b07f-36263311a985', 'db9aaf99-257c-47da-8391-a49540616b54', '2f04ffa0-bd31-401a-b723-8adf7e895053', '06462abc-da02-4fcf-9ef9-4c43f0bfdb1e'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:27 devstack sudo[86935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:27 devstack sudo[86935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:28 devstack sudo[86935]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.500s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:28 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Deleted volume successfully.
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4ebd4e08-4372-41fc-aad1-566ea4d889d4 tempest-VolumesActionsTest-819050836 None] Lock "cinder-52569f3d-6b95-409c-9b88-09be6253003e-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:28 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-905abd3d-a758-4ecd-87ad-ceed0167b40c tempest-GroupsV314Test-610731619 None] Group tempest-GroupsV314Test-Group-1509344599: creating
Apr 21 02:29:28 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-905abd3d-a758-4ecd-87ad-ceed0167b40c tempest-GroupsV314Test-610731619 None] Group tempest-GroupsV314Test-Group-1509344599: created successfully
Apr 21 02:29:28 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-905abd3d-a758-4ecd-87ad-ceed0167b40c tempest-GroupsV314Test-610731619 None] Create group completed successfully.
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (5b4ca852-7b10-490e-80a8-4453567beef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99087ea-e01c-4dcd-abf8-248891c074fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99087ea-e01c-4dcd-abf8-248891c074fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-541177805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26adefcd-a60a-440a-8926-5709e55a8e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:29Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba864ef7-dfe2-4fe3-909f-50f866e04f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba864ef7-dfe2-4fe3-909f-50f866e04f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3256d75b-8ad4-40f2-9564-8dbbb476e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3256d75b-8ad4-40f2-9564-8dbbb476e14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26adefcd-a60a-440a-8926-5709e55a8e74', 'volume_name': 'volume-26adefcd-a60a-440a-8926-5709e55a8e74', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb9cca5-eaef-45d4-8092-2565b23c1eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beb9cca5-eaef-45d4-8092-2565b23c1eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bf61ed-157e-470d-88a7-b17e8181883c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:28 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Volume 26adefcd-a60a-440a-8926-5709e55a8e74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26adefcd-a60a-440a-8926-5709e55a8e74', 'volume_size': 1}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-541177805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26adefcd-a60a-440a-8926-5709e55a8e74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:29Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Creating volume 26adefcd-a60a-440a-8926-5709e55a8e74 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:28 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:28 devstack sudo[86938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74 1073741824
Apr 21 02:29:28 devstack sudo[86938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:29 devstack sudo[86938]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74 1073741824" returned: 0 in 0.546s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:29 devstack sudo[86943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74
Apr 21 02:29:29 devstack sudo[86943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Flow 'volume_create_manager' (66db8238-8abd-4ad7-af2f-958bb1f1a17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb49afb-9a4b-44cb-8fd9-f31d2f68f573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdb49afb-9a4b-44cb-8fd9-f31d2f68f573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-198696238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0cd43834-3c2a-4011-8411-4006454f0d2c,host='devstack@QuobyteHD#QuobyteHD',id=dbecc6a5-131c-49ed-a194-cd531eb1b185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669998f56e514e20ae0d080685f1b10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:30Z,use_quota=True,user_id='042df773449a4cf4ab9241fe7c71280b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1db6869a-85ae-4850-bc5b-9dc009a4dc8f),volume_type_id=1db6869a-85ae-4850-bc5b-9dc009a4dc8f)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f001643c-517a-4116-a62d-0912dfeb3751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f001643c-517a-4116-a62d-0912dfeb3751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a51b7a-f76a-4e49-8482-783e09535d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a51b7a-f76a-4e49-8482-783e09535d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbecc6a5-131c-49ed-a194-cd531eb1b185', 'volume_name': 'volume-dbecc6a5-131c-49ed-a194-cd531eb1b185', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b4a5b4-8f4b-4596-8629-f04f24bdf717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b4a5b4-8f4b-4596-8629-f04f24bdf717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8d30a9-a46f-4c88-badc-718aecab7eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:29 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Volume dbecc6a5-131c-49ed-a194-cd531eb1b185: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbecc6a5-131c-49ed-a194-cd531eb1b185', 'volume_size': 1}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:29 devstack sudo[86943]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74" returned: 0 in 0.484s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.189s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=0cd43834-3c2a-4011-8411-4006454f0d2c,created_at=2026-04-21T00:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-198696238',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=0cd43834-3c2a-4011-8411-4006454f0d2c,host='devstack@QuobyteHD#QuobyteHD',id=dbecc6a5-131c-49ed-a194-cd531eb1b185,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669998f56e514e20ae0d080685f1b10a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:30Z,use_quota=True,user_id='042df773449a4cf4ab9241fe7c71280b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1db6869a-85ae-4850-bc5b-9dc009a4dc8f),volume_type_id=1db6869a-85ae-4850-bc5b-9dc009a4dc8f)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Creating volume dbecc6a5-131c-49ed-a194-cd531eb1b185 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:29 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bf61ed-157e-470d-88a7-b17e8181883c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26adefcd-a60a-440a-8926-5709e55a8e74', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25e00b2-c82a-4c3b-80cd-9ce7efe6b8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:30 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Volume volume-26adefcd-a60a-440a-8926-5709e55a8e74 (26adefcd-a60a-440a-8926-5709e55a8e74): created successfully
Apr 21 02:29:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e25e00b2-c82a-4c3b-80cd-9ce7efe6b8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:30 devstack sudo[86946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 1073741824
Apr 21 02:29:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (5b4ca852-7b10-490e-80a8-4453567beef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:30 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:30 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-4ac585e4-0926-4a37-8b06-28f27bb90174 tempest-VolumesActionsTest-775681778 None] Created volume successfully.
Apr 21 02:29:30 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 1073741824" returned: 0 in 0.571s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:30 devstack sudo[86951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185
Apr 21 02:29:30 devstack sudo[86951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Acquiring lock "cinder-26adefcd-a60a-440a-8926-5709e55a8e74-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:31 devstack sudo[86951]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185" returned: 0 in 0.520s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8d30a9-a46f-4c88-badc-718aecab7eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbecc6a5-131c-49ed-a194-cd531eb1b185', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5583112-36dd-4de0-be68-aa7a96dbe5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Lock "cinder-26adefcd-a60a-440a-8926-5709e55a8e74-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:31 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Volume volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 (dbecc6a5-131c-49ed-a194-cd531eb1b185): created successfully
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5583112-36dd-4de0-be68-aa7a96dbe5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Flow 'volume_create_manager' (66db8238-8abd-4ad7-af2f-958bb1f1a17a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:31 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-7eaaf71f-3a32-4b6b-a87a-ed857090034e tempest-GroupsV314Test-610731619 None] Created volume successfully.
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Acquiring lock "cinder-quobyte-26adefcd-a60a-440a-8926-5709e55a8e74" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Lock "cinder-quobyte-26adefcd-a60a-440a-8926-5709e55a8e74" acquired by "delete_volume" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[73390516-f888-47f9-ac1b-368061b2cbe6]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:31 devstack sudo[86954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74
Apr 21 02:29:31 devstack sudo[86954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:31 devstack sudo[86954]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74" returned: 0 in 0.544s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:31 devstack sudo[86960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74
Apr 21 02:29:31 devstack sudo[86960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:32 devstack sudo[86960]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-26adefcd-a60a-440a-8926-5709e55a8e74" returned: 0 in 0.468s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Lock "cinder-quobyte-26adefcd-a60a-440a-8926-5709e55a8e74" released by "delete_volume" :: held 1.035s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Created reservations ['02fe59da-f5a3-4477-bb1e-02ef1ddf71e8', '1f34b437-851e-4df2-9ea0-83f775502d3c', 'd67f2ca1-7740-43e2-ac9d-1fe4a52ed28f', '0c080b96-2a5e-4ccf-8982-fa8fb69b7893'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:32 devstack sudo[86963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:32 devstack sudo[86963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:32 devstack sudo[86963]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.514s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Deleted volume successfully.
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b1f47a5a-23cb-4754-aaac-e8ff6a4bdb17 tempest-VolumesActionsTest-819050836 None] Lock "cinder-26adefcd-a60a-440a-8926-5709e55a8e74-delete_volume" released by "delete_volume" :: held 1.729s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:32 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Cloning volume dbecc6a5-131c-49ed-a194-cd531eb1b185 to volume 22deed7c-b96c-48e6-a1cf-0c8854355f66
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Creating offline snapshot 0f955c8f-eb8f-4e5a-bce4-98d2a0988923 of volume dbecc6a5-131c-49ed-a194-cd531eb1b185 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b238b3a-472b-4e98-9245-8af1bbb3c1d7]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:32 devstack sudo[86966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185
Apr 21 02:29:32 devstack sudo[86966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:33 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-390ce548-58f3-4df9-b7fb-ece3a481292d tempest-GroupsTest-949284845 None] Group tempest-Group1-1533954318: creating
Apr 21 02:29:33 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-390ce548-58f3-4df9-b7fb-ece3a481292d tempest-GroupsTest-949284845 None] Group tempest-Group1-1533954318: created successfully
Apr 21 02:29:33 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-390ce548-58f3-4df9-b7fb-ece3a481292d tempest-GroupsTest-949284845 None] Create group completed successfully.
Apr 21 02:29:33 devstack sudo[86966]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185" returned: 0 in 0.591s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:33 devstack sudo[86971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923 1G
Apr 21 02:29:33 devstack sudo[86971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (07a58bd5-24c6-4c97-a143-57c7d2e53a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f9d644-8e93-4a6d-b3ac-3e2c9f2a147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f9d644-8e93-4a6d-b3ac-3e2c9f2a147a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-347527669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cbdc955-8a18-4846-ad8c-7ac35cf49bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:34Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40007b0c-9b31-445d-afca-1d306743d495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40007b0c-9b31-445d-afca-1d306743d495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134fc5e4-9271-489b-aa6e-56dd48be5e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134fc5e4-9271-489b-aa6e-56dd48be5e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cbdc955-8a18-4846-ad8c-7ac35cf49bdd', 'volume_name': 'volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a033af9-752a-4911-ab78-7aaecdc43c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a033af9-752a-4911-ab78-7aaecdc43c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e835d649-0cd7-47aa-80d2-bec750175d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:33 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Volume 7cbdc955-8a18-4846-ad8c-7ac35cf49bdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd', 'volume_size': 1}
Apr 21 02:29:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:34 devstack sudo[86971]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923 1G" returned: 0 in 0.576s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:34 devstack sudo[86976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923
Apr 21 02:29:34 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:34 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:UPDATE=149,cinder:DELETE=7,cinder:SELECT=135,cinder:INSERT=35 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:29:34 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-cb530bef-b051-4530-ae7a-45e41845266b tempest-GroupsTest-949284845 None] Group tempest-Group2-387908308: creating
Apr 21 02:29:34 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-cb530bef-b051-4530-ae7a-45e41845266b tempest-GroupsTest-949284845 None] Group tempest-Group2-387908308: created successfully
Apr 21 02:29:34 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-cb530bef-b051-4530-ae7a-45e41845266b tempest-GroupsTest-949284845 None] Create group completed successfully.
Apr 21 02:29:34 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923" returned: 0 in 0.490s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:34 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923 is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:29:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:34 devstack sudo[86981]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923
Apr 21 02:29:34 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:34 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923" returned: 0 in 0.429s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:35 devstack sudo[86984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.info
Apr 21 02:29:35 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Flow 'volume_create_manager' (fd4ea459-fd38-4b59-90a5-8a2d887779d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59284e5f-7eff-4077-89ff-6228061c6a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59284e5f-7eff-4077-89ff-6228061c6a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1070981716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d1d9d1-d9eb-4c70-a0af-1f8ca5411365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd026b755ba2485fa554ef171326b6fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:35Z,use_quota=True,user_id='a5407ac456484f9e96a1e39cd4a08264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712e0cf2-7e04-45bf-9e46-fab815f78ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (712e0cf2-7e04-45bf-9e46-fab815f78ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e526b01c-7cce-4ff2-97b8-782b24a2778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e526b01c-7cce-4ff2-97b8-782b24a2778d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34d1d9d1-d9eb-4c70-a0af-1f8ca5411365', 'volume_name': 'volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0ae598-2b08-4efe-9f0b-837fdf6c621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0ae598-2b08-4efe-9f0b-837fdf6c621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54402745-36fd-4dca-bbbb-20be7e70bd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:35 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Volume 34d1d9d1-d9eb-4c70-a0af-1f8ca5411365: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365', 'volume_size': 1}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:35 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.info" returned: 0 in 0.505s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:35 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.info is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=157,cinder:UPDATE=163,cinder:INSERT=37,cinder:DELETE=9 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:29:35 devstack sudo[86987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.info
Apr 21 02:29:35 devstack sudo[86987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Flow 'volume_create_manager' (7af7a0a8-5878-451a-9cae-7a15e983f4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9e9ae7-3e7d-4f2c-8500-3cb009da71b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d9e9ae7-3e7d-4f2c-8500-3cb009da71b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1108677805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d4b8b501-8a6c-4a9b-be36-075163508058,host='devstack@QuobyteHD#QuobyteHD',id=d7e97a4a-fc57-4c2b-90f0-9bca542261e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d57ce682444b87ab5df8636301ced6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:36Z,use_quota=True,user_id='dcf8eb88e7c04518a028fdfaf681b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d3e4c5b-e57c-4ac2-974e-fdffb5ab1af5),volume_type_id=4d3e4c5b-e57c-4ac2-974e-fdffb5ab1af5)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee7cf66-ecb7-47d2-81a4-ac6fab95f747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee7cf66-ecb7-47d2-81a4-ac6fab95f747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e318e54e-8bef-4e0a-8b3c-86199c059408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e318e54e-8bef-4e0a-8b3c-86199c059408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7e97a4a-fc57-4c2b-90f0-9bca542261e7', 'volume_name': 'volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91700f4-e0f7-4cd8-ac11-58ddc491264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b91700f4-e0f7-4cd8-ac11-58ddc491264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25589ed0-1666-4838-a76d-05d2bbcbf4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:35 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Volume d7e97a4a-fc57-4c2b-90f0-9bca542261e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7', 'volume_size': 1}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:35 devstack sudo[86987]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.info" returned: 0 in 0.436s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Acquiring lock "cinder-quobyte-22deed7c-b96c-48e6-a1cf-0c8854355f66" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Lock "cinder-quobyte-22deed7c-b96c-48e6-a1cf-0c8854355f66" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] snapshot: 0f955c8f-eb8f-4e5a-bce4-98d2a0988923, volume: 22deed7c-b96c-48e6-a1cf-0c8854355f66,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e418092-e110-49c6-888f-63d07a929e80]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:36 devstack sudo[86990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923
Apr 21 02:29:36 devstack sudo[86990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:36 devstack sudo[86990]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923" returned: 0 in 0.483s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbecc6a5-131c-49ed-a194-cd531eb1b185(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:29:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:29:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:29:36 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa507a2c-d4e1-45f3-bda7-ed3ef19d5387]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:36 devstack sudo[86995]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185
Apr 21 02:29:36 devstack sudo[86995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:36 devstack sudo[86995]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185" returned: 0 in 0.460s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:36 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66 not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:29:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:36 devstack sudo[87000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66
Apr 21 02:29:36 devstack sudo[87000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:39 devstack sudo[87000]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66" returned: 0 in 2.110s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:39 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff988e4-2feb-42db-865d-7c3821b7676a]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:39 devstack sudo[87013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185
Apr 21 02:29:39 devstack sudo[87013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:39 devstack sudo[87013]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185" returned: 0 in 0.620s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:39 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185, size 1024.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:29:39 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Converted 1024.00 MB image at 485.08 MB/s
Apr 21 02:29:39 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66 is being set with open permissions: ugo+rw: NotImplementedError
Apr 21 02:29:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:39 devstack sudo[87018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66
Apr 21 02:29:39 devstack sudo[87018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:40 devstack sudo[87018]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66" returned: 0 in 0.394s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Lock "cinder-quobyte-22deed7c-b96c-48e6-a1cf-0c8854355f66" released by "_copy_volume_from_snapshot" :: held 4.109s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Acquiring lock "cinder-quobyte-0f955c8f-eb8f-4e5a-bce4-98d2a0988923" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Lock "cinder-quobyte-0f955c8f-eb8f-4e5a-bce4-98d2a0988923" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Deleting offline snapshot 0f955c8f-eb8f-4e5a-bce4-98d2a0988923 of volume dbecc6a5-131c-49ed-a194-cd531eb1b185 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] snapshot_file for this snap is: volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[39074bac-5f47-430a-a689-b17c39e48691]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:40 devstack sudo[87021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923
Apr 21 02:29:40 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:40 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923" returned: 0 in 0.473s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbecc6a5-131c-49ed-a194-cd531eb1b185(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[b521e395-5a6f-47dd-ad05-c05cc334bee2]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:40 devstack sudo[87026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185
Apr 21 02:29:40 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:41 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185" returned: 0 in 0.504s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:41 devstack sudo[87031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923
Apr 21 02:29:41 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:41 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923" returned: 0 in 0.448s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:41 devstack sudo[87037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923
Apr 21 02:29:41 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:41 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185.0f955c8f-eb8f-4e5a-bce4-98d2a0988923" returned: 0 in 0.390s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Lock "cinder-quobyte-0f955c8f-eb8f-4e5a-bce4-98d2a0988923" released by "_delete_snapshot" :: held 1.857s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.113s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.363s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-347527669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cbdc955-8a18-4846-ad8c-7ac35cf49bdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:34Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Creating volume 7cbdc955-8a18-4846-ad8c-7ac35cf49bdd {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:41 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:41 devstack sudo[87040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd 1073741824
Apr 21 02:29:41 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:42 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-dead1062-4f20-463e-9af1-ac43d89686ee tempest-GroupsV314Test-610731619 None] Create group from source-group-0cd43834-3c2a-4011-8411-4006454f0d2c completed successfully.
Apr 21 02:29:42 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd 1073741824" returned: 0 in 0.485s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:42 devstack sudo[87045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd
Apr 21 02:29:42 devstack sudo[87045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Acquiring lock "cinder-quobyte-22deed7c-b96c-48e6-a1cf-0c8854355f66" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Lock "cinder-quobyte-22deed7c-b96c-48e6-a1cf-0c8854355f66" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5dc82a-6510-4498-aaaa-44a7be9da74f]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:42 devstack sudo[87047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66
Apr 21 02:29:42 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:42 devstack sudo[87045]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd" returned: 0 in 0.426s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.639s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1070981716',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d1d9d1-d9eb-4c70-a0af-1f8ca5411365,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd026b755ba2485fa554ef171326b6fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:35Z,use_quota=True,user_id='a5407ac456484f9e96a1e39cd4a08264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Creating volume 34d1d9d1-d9eb-4c70-a0af-1f8ca5411365 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:42 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e835d649-0cd7-47aa-80d2-bec750175d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111fb448-838b-4a71-b881-5ef29953e553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:42 devstack sudo[87050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365 1073741824
Apr 21 02:29:42 devstack sudo[87050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:42 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Volume volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd (7cbdc955-8a18-4846-ad8c-7ac35cf49bdd): created successfully
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (111fb448-838b-4a71-b881-5ef29953e553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (07a58bd5-24c6-4c97-a143-57c7d2e53a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:42 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c844c707-3258-4312-a544-730a540631e2 tempest-VolumesActionsTest-775681778 None] Created volume successfully.
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Acquiring lock "cinder-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Lock "cinder-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Acquiring lock "cinder-quobyte-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Lock "cinder-quobyte-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd" acquired by "delete_volume" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fc4d0f-dddc-4009-9082-0d34dabd22af]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:43 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66" returned: 0 in 0.584s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:43 devstack sudo[87059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66
Apr 21 02:29:43 devstack sudo[87059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:43 devstack sudo[87058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd
Apr 21 02:29:43 devstack sudo[87058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:43 devstack sudo[87050]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365 1073741824" returned: 0 in 0.507s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:43 devstack sudo[87062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365
Apr 21 02:29:43 devstack sudo[87062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:43 devstack sudo[87059]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-22deed7c-b96c-48e6-a1cf-0c8854355f66" returned: 0 in 0.442s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Lock "cinder-quobyte-22deed7c-b96c-48e6-a1cf-0c8854355f66" released by "delete_volume" :: held 1.048s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:43 devstack sudo[87058]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd" returned: 0 in 0.520s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:43 devstack sudo[87062]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365" returned: 0 in 0.429s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:43 devstack sudo[87069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd
Apr 21 02:29:43 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.274s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=d4b8b501-8a6c-4a9b-be36-075163508058,created_at=2026-04-21T00:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1108677805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=d4b8b501-8a6c-4a9b-be36-075163508058,host='devstack@QuobyteHD#QuobyteHD',id=d7e97a4a-fc57-4c2b-90f0-9bca542261e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d57ce682444b87ab5df8636301ced6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:36Z,use_quota=True,user_id='dcf8eb88e7c04518a028fdfaf681b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d3e4c5b-e57c-4ac2-974e-fdffb5ab1af5),volume_type_id=4d3e4c5b-e57c-4ac2-974e-fdffb5ab1af5)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Creating volume d7e97a4a-fc57-4c2b-90f0-9bca542261e7 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:43 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54402745-36fd-4dca-bbbb-20be7e70bd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:43 devstack sudo[87071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7 1073741824
Apr 21 02:29:43 devstack sudo[87071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f7047c-8287-413a-b4c6-d6dadbdfe5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Created reservations ['9cada38f-c3b8-42da-bc84-ed189c2400a0'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:43 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Volume volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365 (34d1d9d1-d9eb-4c70-a0af-1f8ca5411365): created successfully
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f7047c-8287-413a-b4c6-d6dadbdfe5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Flow 'volume_create_manager' (fd4ea459-fd38-4b59-90a5-8a2d887779d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:43 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-990921f7-aaa6-41cd-b6a3-cf23371f3cd4 tempest-VolumeQuotasNegativeTestJSON-718092167 None] Created volume successfully.
Apr 21 02:29:43 devstack cinder-volume[82686]: WARNING cinder.quota [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1263623525 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1263623525, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:43 devstack cinder-volume[82686]: WARNING cinder.quota [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1263623525 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1263623525, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:43 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Created reservations ['a38069c1-054e-4c8f-bfb8-76bbeacd0b11', '83b4d0d5-dac9-4690-8155-8647746462da', '327b0e66-d847-4514-98bb-993fd9779483', 'a2dd9393-7f61-4b7c-b8d6-498eba5620b1'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:44 devstack sudo[87073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:44 devstack sudo[87073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:44 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd" returned: 0 in 0.427s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Lock "cinder-quobyte-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd" released by "delete_volume" :: held 0.980s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Created reservations ['7222cb5a-775a-4c79-a002-c3e9e7150d94', '7f75804f-99bb-426e-b4ec-bb10d1769577', 'c961387b-91ae-45a0-aa01-13dee72f5dc2', 'd83c0db0-42cd-497c-bfea-eb8e6c27c9f9'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:44 devstack sudo[87080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:44 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:44 devstack sudo[87073]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.424s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:44 devstack sudo[87071]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:44 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-08326064-b861-47c7-984f-97c9f530bcd1 tempest-GroupsV314Test-610731619 None] Delete group completed successfully.
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7 1073741824" returned: 0 in 0.581s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:44 devstack sudo[87082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7
Apr 21 02:29:44 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (ca3cfb8e-6492-4870-a4f1-b5d5e1783b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55eee056-66a6-4307-90da-57de3994b49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55eee056-66a6-4307-90da-57de3994b49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1406847595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d94695-709a-4e4f-9dc3-5274a3af9ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:45Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2df294-ab14-44ed-9e73-ef22641cd9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2df294-ab14-44ed-9e73-ef22641cd9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c7be1b-bba9-47dd-8a99-485ee8e565b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2c7be1b-bba9-47dd-8a99-485ee8e565b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d94695-709a-4e4f-9dc3-5274a3af9ffc', 'volume_name': 'volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3202d41b-b291-4e18-9f5c-ec41abe387c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3202d41b-b291-4e18-9f5c-ec41abe387c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15459776-8203-4922-ab1d-ed2a03ab9920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:44 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Volume d9d94695-709a-4e4f-9dc3-5274a3af9ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc', 'volume_size': 1}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:44 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.511s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:44 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Deleted volume successfully.
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a5ab75f6-52e9-4e51-9555-59947cd1b60f tempest-VolumesActionsTest-819050836 None] Lock "cinder-7cbdc955-8a18-4846-ad8c-7ac35cf49bdd-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:44 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7" returned: 0 in 0.474s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] <== create_volume: return (1081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.084s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.248s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1406847595',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d94695-709a-4e4f-9dc3-5274a3af9ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08cd56418874675ae820da1390d0227',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:45Z,use_quota=True,user_id='89b6ed6811e14f8b8624d6038e230aa0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Creating volume d9d94695-709a-4e4f-9dc3-5274a3af9ffc {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:44 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25589ed0-1666-4838-a76d-05d2bbcbf4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:44 devstack sudo[87086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc 1073741824
Apr 21 02:29:45 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f1d724-96e1-46d7-856f-3b59ec28f40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:45 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Volume volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7 (d7e97a4a-fc57-4c2b-90f0-9bca542261e7): created successfully
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f1d724-96e1-46d7-856f-3b59ec28f40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Flow 'volume_create_manager' (7af7a0a8-5878-451a-9cae-7a15e983f4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:45 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e6837863-09db-4bd7-aa61-005278052779 tempest-GroupsTest-949284845 None] Created volume successfully.
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Acquiring lock "cinder-quobyte-dbecc6a5-131c-49ed-a194-cd531eb1b185" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Lock "cinder-quobyte-dbecc6a5-131c-49ed-a194-cd531eb1b185" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1f62ba-49f5-4234-a471-87a7b8a201fd]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:45 devstack sudo[87088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185
Apr 21 02:29:45 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Acquiring lock "cinder-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Lock "cinder-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Acquiring lock "cinder-quobyte-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Lock "cinder-quobyte-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c4deca-9901-4930-8f31-907c58c2bc2b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:45 devstack sudo[87092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365
Apr 21 02:29:45 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:45 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc 1073741824" returned: 0 in 0.610s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:45 devstack sudo[87095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc
Apr 21 02:29:45 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Acquiring lock "cinder-quobyte-d7e97a4a-fc57-4c2b-90f0-9bca542261e7" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Lock "cinder-quobyte-d7e97a4a-fc57-4c2b-90f0-9bca542261e7" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb904c5-653b-4e88-a300-a746e0af4b25]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:45 devstack sudo[87100]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7
Apr 21 02:29:45 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:45 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185" returned: 0 in 0.630s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:45 devstack sudo[87102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185
Apr 21 02:29:45 devstack sudo[87102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:45 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365" returned: 0 in 0.591s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:46 devstack sudo[87108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365
Apr 21 02:29:46 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:46 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc" returned: 0 in 0.488s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15459776-8203-4922-ab1d-ed2a03ab9920) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdcf0a12-ba4d-48ae-b8e9-d01a2913b89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:46 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Volume volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc (d9d94695-709a-4e4f-9dc3-5274a3af9ffc): created successfully
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdcf0a12-ba4d-48ae-b8e9-d01a2913b89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Flow 'volume_create_manager' (ca3cfb8e-6492-4870-a4f1-b5d5e1783b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:46 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9f007d8a-67c8-4ca4-87a0-bfbc05c0d62f tempest-VolumesActionsTest-775681778 None] Created volume successfully.
Apr 21 02:29:46 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7" returned: 0 in 0.485s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:46 devstack sudo[87114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7
Apr 21 02:29:46 devstack sudo[87114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:46 devstack sudo[87102]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-dbecc6a5-131c-49ed-a194-cd531eb1b185" returned: 0 in 0.445s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Lock "cinder-quobyte-dbecc6a5-131c-49ed-a194-cd531eb1b185" released by "delete_volume" :: held 1.115s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Created reservations ['f10b34a7-031a-4129-a371-8dfe20851726'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Created reservations ['9d278be7-0762-4a98-8edb-f211e98a147e', 'a8cc1a4b-a02b-4cee-b3c8-707029ed7d69', '745a0648-ab7b-4b1d-89f6-27c4ab10d013', '4320f83e-6d8f-4ec7-9fc6-53651274ebd1'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:46 devstack sudo[87117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:46 devstack sudo[87117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:46 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365" returned: 0 in 0.461s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Lock "cinder-quobyte-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365" released by "delete_volume" :: held 1.073s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Created reservations ['f67a71a2-3f89-4122-bc88-3c4b5f5438da', '002c04d4-db40-4f57-892d-a028e48c3c7c', '00c59907-4bf4-48c7-850d-03821183ae5a', '63c397cd-0dde-4256-958e-1b969709bc21'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:46 devstack sudo[87120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:46 devstack sudo[87120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:46 devstack sudo[87114]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d7e97a4a-fc57-4c2b-90f0-9bca542261e7" returned: 0 in 0.439s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Lock "cinder-quobyte-d7e97a4a-fc57-4c2b-90f0-9bca542261e7" released by "delete_volume" :: held 0.945s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Created reservations ['3f550764-d47d-4a93-a9aa-d23242418d64'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:46 devstack cinder-volume[82686]: WARNING cinder.quota [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2030291245 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2030291245, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:46 devstack cinder-volume[82686]: WARNING cinder.quota [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2030291245 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2030291245, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Created reservations ['90bf506d-5a50-44b3-a908-4e032f017af6', '462cb5dd-1528-4d68-b621-8e5572be12cf', '638d89da-aca7-4f0a-8e8a-7fb72b8b230a', '98d41be6-d242-427c-9d74-74dde39bacc1'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:46 devstack sudo[87122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:46 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:46 devstack sudo[87117]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.499s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:46 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-391ddae4-c370-4832-906d-61023bcd7a61 tempest-GroupsV314Test-610731619 None] Delete group completed successfully.
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-90698fd5-0de1-422e-82d7-f008c1f4fb2f tempest-GroupsTest-949284845 None] Created reservations ['66397480-86f9-47d5-b6e2-61099c586fab'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-90698fd5-0de1-422e-82d7-f008c1f4fb2f tempest-GroupsTest-949284845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-90698fd5-0de1-422e-82d7-f008c1f4fb2f tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-90698fd5-0de1-422e-82d7-f008c1f4fb2f tempest-GroupsTest-949284845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-90698fd5-0de1-422e-82d7-f008c1f4fb2f tempest-GroupsTest-949284845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-90698fd5-0de1-422e-82d7-f008c1f4fb2f tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-90698fd5-0de1-422e-82d7-f008c1f4fb2f tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:46 devstack sudo[87126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:46 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:46 devstack sudo[87120]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.441s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:46 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:46 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Deleted volume successfully.
Apr 21 02:29:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ff0fe73e-0a13-4226-9090-a49a9181abbf tempest-VolumeQuotasNegativeTestJSON-718092167 None] Lock "cinder-34d1d9d1-d9eb-4c70-a0af-1f8ca5411365-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:47 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.487s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:47 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:47 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f46f7e57-8a8d-46d3-b777-3c3ab9e62291 tempest-GroupsTest-949284845 None] Delete group completed successfully.
Apr 21 02:29:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Acquiring lock "cinder-d9d94695-709a-4e4f-9dc3-5274a3af9ffc-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Lock "cinder-d9d94695-709a-4e4f-9dc3-5274a3af9ffc-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:47 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-90698fd5-0de1-422e-82d7-f008c1f4fb2f tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.497s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:47 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-90698fd5-0de1-422e-82d7-f008c1f4fb2f tempest-GroupsTest-949284845 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:47 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-90698fd5-0de1-422e-82d7-f008c1f4fb2f tempest-GroupsTest-949284845 None] Delete group completed successfully.
Apr 21 02:29:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Acquiring lock "cinder-quobyte-d9d94695-709a-4e4f-9dc3-5274a3af9ffc" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Lock "cinder-quobyte-d9d94695-709a-4e4f-9dc3-5274a3af9ffc" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:47 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29f72f1-f468-49d9-8e37-0a56e906cff7]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:47 devstack sudo[87130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc
Apr 21 02:29:47 devstack sudo[87130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:48 devstack sudo[87130]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc" returned: 0 in 0.579s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:48 devstack sudo[87135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc
Apr 21 02:29:48 devstack sudo[87135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d018c90d-f5c0-4344-8a2b-2950132f67eb tempest-GroupsTest-949284845 None] Group tempest-GroupsTest-Group-65000557: creating
Apr 21 02:29:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d018c90d-f5c0-4344-8a2b-2950132f67eb tempest-GroupsTest-949284845 None] Group tempest-GroupsTest-Group-65000557: created successfully
Apr 21 02:29:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d018c90d-f5c0-4344-8a2b-2950132f67eb tempest-GroupsTest-949284845 None] Create group completed successfully.
Apr 21 02:29:48 devstack sudo[87135]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9d94695-709a-4e4f-9dc3-5274a3af9ffc" returned: 0 in 0.636s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Lock "cinder-quobyte-d9d94695-709a-4e4f-9dc3-5274a3af9ffc" released by "delete_volume" :: held 1.242s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:48 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Created reservations ['b9e8dded-6a89-4d5e-9f9a-ed4ca158cd29', 'fb1b25a5-db62-4561-ba07-7c41b03c5472', '9b8cab70-911d-4ef6-9525-ebe9af559b1a', '91592f88-5f6b-4aa7-b8fb-58ad5a11e0b7'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:48 devstack sudo[87139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:48 devstack sudo[87139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:49 devstack sudo[87139]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.504s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:49 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Deleted volume successfully.
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-baefbc98-a4bb-4ff2-9aec-ea403dfbfc4b tempest-VolumesActionsTest-775681778 None] Lock "cinder-d9d94695-709a-4e4f-9dc3-5274a3af9ffc-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Flow 'volume_create_manager' (cc9eabb6-b08d-45ee-a535-39e0f94e3ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7666ca19-7192-4015-8283-4392a0eaed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7666ca19-7192-4015-8283-4392a0eaed8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-489091853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a673378-3557-4e22-a2c8-a28b9b9cea56,host='devstack@QuobyteHD#QuobyteHD',id=3b238d1f-6c0b-4639-930c-d2112bf04eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d57ce682444b87ab5df8636301ced6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:50Z,use_quota=True,user_id='dcf8eb88e7c04518a028fdfaf681b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3cc1e55-6d37-4686-b0f2-2335370f362c),volume_type_id=b3cc1e55-6d37-4686-b0f2-2335370f362c)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5f0734-f954-4c6b-a560-9622ae171d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b5f0734-f954-4c6b-a560-9622ae171d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ffa8be-d54d-4faa-aa3a-bbbad18505c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7ffa8be-d54d-4faa-aa3a-bbbad18505c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b238d1f-6c0b-4639-930c-d2112bf04eb1', 'volume_name': 'volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da875fd3-f9ed-46a5-8348-c3db3fcdf1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da875fd3-f9ed-46a5-8348-c3db3fcdf1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a444d01c-a373-4f0d-9015-0d37ad79673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:49 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Volume 3b238d1f-6c0b-4639-930c-d2112bf04eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1', 'volume_size': 1}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5a673378-3557-4e22-a2c8-a28b9b9cea56,created_at=2026-04-21T00:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-489091853',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a673378-3557-4e22-a2c8-a28b9b9cea56,host='devstack@QuobyteHD#QuobyteHD',id=3b238d1f-6c0b-4639-930c-d2112bf04eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d57ce682444b87ab5df8636301ced6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:50Z,use_quota=True,user_id='dcf8eb88e7c04518a028fdfaf681b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3cc1e55-6d37-4686-b0f2-2335370f362c),volume_type_id=b3cc1e55-6d37-4686-b0f2-2335370f362c)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Creating volume 3b238d1f-6c0b-4639-930c-d2112bf04eb1 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:49 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:49 devstack sudo[87142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1 1073741824
Apr 21 02:29:49 devstack sudo[87142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:50 devstack sudo[87142]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1 1073741824" returned: 0 in 0.596s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:50 devstack sudo[87148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1
Apr 21 02:29:50 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Flow 'volume_create_manager' (b1ada55b-96be-4658-961f-0cb9e0d915a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b20f1f2-5a19-43bf-bc5e-611594e66574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b20f1f2-5a19-43bf-bc5e-611594e66574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1854131850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfd77ad-8e14-42e5-beb5-b5b275634519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce6ecdbdfc43568412c02663190fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:51Z,use_quota=True,user_id='ae9cf57761364024aab721ff3ae848d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a40884e7-bdef-4bb3-8855-2e648ab6de7a),volume_type_id=a40884e7-bdef-4bb3-8855-2e648ab6de7a)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078079f2-b25a-44c7-b94e-d34bcc06ec41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078079f2-b25a-44c7-b94e-d34bcc06ec41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ba6cc8-5269-4db8-855f-f914de6ec3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87ba6cc8-5269-4db8-855f-f914de6ec3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cfd77ad-8e14-42e5-beb5-b5b275634519', 'volume_name': 'volume-7cfd77ad-8e14-42e5-beb5-b5b275634519', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6294516b-aff9-4016-9a4f-de4995c5c16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6294516b-aff9-4016-9a4f-de4995c5c16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e4a951-e08f-40e1-8627-849b92302ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:51 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Volume 7cfd77ad-8e14-42e5-beb5-b5b275634519: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cfd77ad-8e14-42e5-beb5-b5b275634519', 'volume_size': 1}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:51 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1" returned: 0 in 0.580s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.020s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1854131850',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cfd77ad-8e14-42e5-beb5-b5b275634519,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9ce6ecdbdfc43568412c02663190fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:51Z,use_quota=True,user_id='ae9cf57761364024aab721ff3ae848d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a40884e7-bdef-4bb3-8855-2e648ab6de7a),volume_type_id=a40884e7-bdef-4bb3-8855-2e648ab6de7a)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Creating volume 7cfd77ad-8e14-42e5-beb5-b5b275634519 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:51 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a444d01c-a373-4f0d-9015-0d37ad79673f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61c5832-ea82-4aa8-a9a3-94c216cb9989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:51 devstack sudo[87158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519 1073741824
Apr 21 02:29:51 devstack sudo[87158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:51 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Volume volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1 (3b238d1f-6c0b-4639-930c-d2112bf04eb1): created successfully
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d61c5832-ea82-4aa8-a9a3-94c216cb9989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Flow 'volume_create_manager' (cc9eabb6-b08d-45ee-a535-39e0f94e3ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:51 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9801bfae-ca36-4c3b-a5f5-76206012f725 tempest-GroupsTest-949284845 None] Created volume successfully.
Apr 21 02:29:51 devstack sudo[87158]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519 1073741824" returned: 0 in 0.615s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:51 devstack sudo[87164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519
Apr 21 02:29:51 devstack sudo[87164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:52 devstack sudo[87164]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519" returned: 0 in 0.512s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e4a951-e08f-40e1-8627-849b92302ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cfd77ad-8e14-42e5-beb5-b5b275634519', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba96699-4ed1-4b09-bb9d-dd5dae10f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:52 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Volume volume-7cfd77ad-8e14-42e5-beb5-b5b275634519 (7cfd77ad-8e14-42e5-beb5-b5b275634519): created successfully
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ba96699-4ed1-4b09-bb9d-dd5dae10f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Flow 'volume_create_manager' (b1ada55b-96be-4658-961f-0cb9e0d915a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:52 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-97f45d06-bb78-45ad-865f-6e17d3592c78 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Created volume successfully.
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Flow 'volume_create_manager' (9fb60762-042c-4254-9d96-e5ce01e0c5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f44a61-48bd-40df-95de-76658bb7f297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f44a61-48bd-40df-95de-76658bb7f297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1831815682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a673378-3557-4e22-a2c8-a28b9b9cea56,host='devstack@QuobyteHD#QuobyteHD',id=85d0e119-a85e-4735-b9ca-737657eba0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d57ce682444b87ab5df8636301ced6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:52Z,use_quota=True,user_id='dcf8eb88e7c04518a028fdfaf681b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3cc1e55-6d37-4686-b0f2-2335370f362c),volume_type_id=b3cc1e55-6d37-4686-b0f2-2335370f362c)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfde9d5d-e57e-4228-9f09-d865cb00ebd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfde9d5d-e57e-4228-9f09-d865cb00ebd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95793a08-5736-48dc-8aa7-67daef531376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95793a08-5736-48dc-8aa7-67daef531376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85d0e119-a85e-4735-b9ca-737657eba0e3', 'volume_name': 'volume-85d0e119-a85e-4735-b9ca-737657eba0e3', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9075ca-aba0-4b41-878d-23d4c4110240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce9075ca-aba0-4b41-878d-23d4c4110240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a284329-8787-464b-bef4-698e270518ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:52 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Volume 85d0e119-a85e-4735-b9ca-737657eba0e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85d0e119-a85e-4735-b9ca-737657eba0e3', 'volume_size': 1}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5a673378-3557-4e22-a2c8-a28b9b9cea56,created_at=2026-04-21T00:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1831815682',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5a673378-3557-4e22-a2c8-a28b9b9cea56,host='devstack@QuobyteHD#QuobyteHD',id=85d0e119-a85e-4735-b9ca-737657eba0e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d57ce682444b87ab5df8636301ced6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:52Z,use_quota=True,user_id='dcf8eb88e7c04518a028fdfaf681b846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3cc1e55-6d37-4686-b0f2-2335370f362c),volume_type_id=b3cc1e55-6d37-4686-b0f2-2335370f362c)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Creating volume 85d0e119-a85e-4735-b9ca-737657eba0e3 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:52 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:52 devstack sudo[87168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3 1073741824
Apr 21 02:29:52 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:53 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3 1073741824" returned: 0 in 0.594s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:53 devstack sudo[87173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3
Apr 21 02:29:53 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8c9d5f32-5190-4128-841b-d1549a89b060 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8c9d5f32-5190-4128-841b-d1549a89b060 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8c9d5f32-5190-4128-841b-d1549a89b060 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8c9d5f32-5190-4128-841b-d1549a89b060 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8c9d5f32-5190-4128-841b-d1549a89b060 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8c9d5f32-5190-4128-841b-d1549a89b060 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:53 devstack sudo[87175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:53 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:53 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3" returned: 0 in 0.528s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a284329-8787-464b-bef4-698e270518ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85d0e119-a85e-4735-b9ca-737657eba0e3', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4452d5-e31e-40fd-835a-778e1218dc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:53 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Volume volume-85d0e119-a85e-4735-b9ca-737657eba0e3 (85d0e119-a85e-4735-b9ca-737657eba0e3): created successfully
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee4452d5-e31e-40fd-835a-778e1218dc0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Flow 'volume_create_manager' (9fb60762-042c-4254-9d96-e5ce01e0c5f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-61e39f2b-c8cb-4ee2-b90e-890ec072fd92 tempest-GroupsTest-949284845 None] Created volume successfully.
Apr 21 02:29:54 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8c9d5f32-5190-4128-841b-d1549a89b060 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.536s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-8c9d5f32-5190-4128-841b-d1549a89b060 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:54 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-8c9d5f32-5190-4128-841b-d1549a89b060 tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Retype volume completed successfully.
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Flow 'volume_create_manager' (58385bfb-080e-41e4-bcc0-be6793065f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83932eb-15c9-46fd-a7d5-031d9f97b969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83932eb-15c9-46fd-a7d5-031d9f97b969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1194179528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c739f9-97b2-4e63-b6b2-da301005641e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb48f9061dd443faef9ae9b62c8ddb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:54Z,use_quota=True,user_id='c084d5984f0f47f68f5e482b3faafe2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61c3508-5283-4be0-bc25-18dfc1131f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f61c3508-5283-4be0-bc25-18dfc1131f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6e7def-4fad-4f0e-b8a9-5e76f5435c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6e7def-4fad-4f0e-b8a9-5e76f5435c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62c739f9-97b2-4e63-b6b2-da301005641e', 'volume_name': 'volume-62c739f9-97b2-4e63-b6b2-da301005641e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694dd3d2-dda8-4f78-83d0-14f632dc5a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (694dd3d2-dda8-4f78-83d0-14f632dc5a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c31f421-cc6d-4c84-a0e3-ce9d1ea39b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:54 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Volume 62c739f9-97b2-4e63-b6b2-da301005641e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62c739f9-97b2-4e63-b6b2-da301005641e', 'volume_size': 1}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1194179528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62c739f9-97b2-4e63-b6b2-da301005641e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb48f9061dd443faef9ae9b62c8ddb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:54Z,use_quota=True,user_id='c084d5984f0f47f68f5e482b3faafe2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Creating volume 62c739f9-97b2-4e63-b6b2-da301005641e {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:29:54 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:54 devstack sudo[87180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e 1073741824
Apr 21 02:29:54 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Acquiring lock "cinder-7cfd77ad-8e14-42e5-beb5-b5b275634519-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:54 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c7f208c7-3240-47d7-b02f-d00f69fb336d tempest-GroupsTest-949284845 None] Update group completed successfully.
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "cinder-7cfd77ad-8e14-42e5-beb5-b5b275634519-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Acquiring lock "cinder-quobyte-7cfd77ad-8e14-42e5-beb5-b5b275634519" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "cinder-quobyte-7cfd77ad-8e14-42e5-beb5-b5b275634519" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2ebe16-cfc5-405f-a9d4-6ed815cd97bb]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:54 devstack sudo[87182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519
Apr 21 02:29:54 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:55 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e 1073741824" returned: 0 in 0.621s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:55 devstack sudo[87187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e
Apr 21 02:29:55 devstack sudo[87187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:55 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519" returned: 0 in 0.567s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:55 devstack sudo[87193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519
Apr 21 02:29:55 devstack sudo[87193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:55 devstack sudo[87187]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e" returned: 0 in 0.445s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c31f421-cc6d-4c84-a0e3-ce9d1ea39b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62c739f9-97b2-4e63-b6b2-da301005641e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520bda88-442d-47a6-8486-4fe37282f634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:55 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Volume volume-62c739f9-97b2-4e63-b6b2-da301005641e (62c739f9-97b2-4e63-b6b2-da301005641e): created successfully
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (520bda88-442d-47a6-8486-4fe37282f634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Flow 'volume_create_manager' (58385bfb-080e-41e4-bcc0-be6793065f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:55 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-59cbdcdf-88d9-4b00-b3bf-eb615ccd9693 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Created volume successfully.
Apr 21 02:29:55 devstack sudo[87193]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7cfd77ad-8e14-42e5-beb5-b5b275634519" returned: 0 in 0.444s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "cinder-quobyte-7cfd77ad-8e14-42e5-beb5-b5b275634519" released by "delete_volume" :: held 1.046s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:55 devstack cinder-volume[82686]: WARNING cinder.quota [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:55 devstack cinder-volume[82686]: WARNING cinder.quota [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Created reservations ['bc6af763-073d-4161-8800-33164b067b30', '2a253b67-1c81-4c33-a3a9-f2aec76fadf0', 'e42e9fcb-7fc0-4885-8881-ae3b88a42953', '5ab638c5-bbd6-4cac-888e-e7e286c103c6'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:56 devstack sudo[87197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:56 devstack sudo[87197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:56 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f0dda3ec-9044-40ee-9b3e-0db5c77732cf tempest-GroupsTest-949284845 None] Update group completed successfully.
Apr 21 02:29:56 devstack sudo[87197]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.456s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:56 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:29:56 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Deleted volume successfully.
Apr 21 02:29:56 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-27cbe705-72b3-4f07-af8f-72aec7edaf9a tempest-VolumeRetypeWithoutMigrationTest-1877179234 None] Lock "cinder-7cfd77ad-8e14-42e5-beb5-b5b275634519-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Creating offline snapshot d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 of volume 62c739f9-97b2-4e63-b6b2-da301005641e {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:29:56 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6c241b-c442-4b0e-864a-9e4453160aa5]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:56 devstack sudo[87200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e
Apr 21 02:29:56 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:57 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Acquiring lock "cinder-quobyte-3b238d1f-6c0b-4639-930c-d2112bf04eb1" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:57 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Lock "cinder-quobyte-3b238d1f-6c0b-4639-930c-d2112bf04eb1" acquired by "delete_volume" :: waited 0.025s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:57 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e" returned: 0 in 0.656s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:57 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b2e45d-b7b6-4776-b269-d8db327fe20e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:57 devstack sudo[87205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 1G
Apr 21 02:29:57 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:57 devstack sudo[87206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1
Apr 21 02:29:57 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:58 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1" returned: 0 in 0.621s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:58 devstack sudo[87249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1
Apr 21 02:29:58 devstack sudo[87249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:58 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 1G" returned: 0 in 0.701s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c739f9-97b2-4e63-b6b2-da301005641e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:58 devstack sudo[87251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c739f9-97b2-4e63-b6b2-da301005641e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3
Apr 21 02:29:58 devstack sudo[87251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:58 devstack sudo[87249]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3b238d1f-6c0b-4639-930c-d2112bf04eb1" returned: 0 in 0.557s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Lock "cinder-quobyte-3b238d1f-6c0b-4639-930c-d2112bf04eb1" released by "delete_volume" :: held 1.224s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Acquiring lock "cinder-quobyte-85d0e119-a85e-4735-b9ca-737657eba0e3" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Lock "cinder-quobyte-85d0e119-a85e-4735-b9ca-737657eba0e3" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46f762f-7ca1-4fc3-a343-fa25418e69b0]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:58 devstack sudo[87251]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62c739f9-97b2-4e63-b6b2-da301005641e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3" returned: 0 in 0.618s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:58 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 is being set with open permissions: ugo+rw
Apr 21 02:29:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:58 devstack sudo[87257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3
Apr 21 02:29:58 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:58 devstack sudo[87258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3
Apr 21 02:29:58 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:59 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3" returned: 0 in 0.578s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:59 devstack sudo[87265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3
Apr 21 02:29:59 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:59 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3" returned: 0 in 0.657s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:59 devstack sudo[87267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.info
Apr 21 02:29:59 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Flow 'volume_create_manager' (c60a7b1e-2f45-4b44-88eb-c6f53f87e34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683a5ecc-f8ad-44ea-a84d-2ec8ceb375ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (683a5ecc-f8ad-44ea-a84d-2ec8ceb375ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1847846254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0bd289-fb74-435c-948b-906d919e4c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e6681f1c7479a87bece5318969894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:59Z,use_quota=True,user_id='40e6142baa1a4d96a92f7988517d24c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785fce02-72cb-4db2-b3f1-efc299fe4ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (785fce02-72cb-4db2-b3f1-efc299fe4ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdf0d71-1e67-4401-9ddc-3cf4c7f7f50a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfdf0d71-1e67-4401-9ddc-3cf4c7f7f50a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe0bd289-fb74-435c-948b-906d919e4c1f', 'volume_name': 'volume-fe0bd289-fb74-435c-948b-906d919e4c1f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f0ff70-28e3-4394-b203-c2f71c61eec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37f0ff70-28e3-4394-b203-c2f71c61eec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f71b75f-4f94-4871-81d2-bdb5f7a897e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:29:59 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Volume fe0bd289-fb74-435c-948b-906d919e4c1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe0bd289-fb74-435c-948b-906d919e4c1f', 'volume_size': 1}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:59 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85d0e119-a85e-4735-b9ca-737657eba0e3" returned: 0 in 0.449s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Lock "cinder-quobyte-85d0e119-a85e-4735-b9ca-737657eba0e3" released by "delete_volume" :: held 1.049s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Created reservations ['af30520f-dae0-46d4-862b-78189dbe8a02'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:59 devstack cinder-volume[82686]: WARNING cinder.quota [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1981836089 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1981836089, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:59 devstack cinder-volume[82686]: WARNING cinder.quota [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1981836089 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1981836089, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Created reservations ['df7465d3-f999-4020-bbf4-54c173965618', '7cd4f5b3-3281-4d95-8b50-f34cb5d1951d', '2e4681f9-c3a6-48b8-a42c-c6ab2464e6d5', '627547b4-ea36-46bc-ae7f-87474c82005e'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Created reservations ['5916bec1-8fc2-42ab-877a-c6d70669e2ab', '714f8642-8e56-4be3-a5d7-6b2f7bc4943f', '7f880c57-da6b-46f1-a4e1-493f33dc1150', 'c84ebe2d-2b9b-4588-988e-716a2f1493bf'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:59 devstack sudo[87271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:29:59 devstack sudo[87271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:29:59 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.info" returned: 0 in 0.532s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:29:59 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.info is being set with open permissions: ugo+rw
Apr 21 02:29:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:29:59 devstack sudo[87273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.info
Apr 21 02:29:59 devstack sudo[87273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:00 devstack sudo[87273]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.info" returned: 0 in 0.420s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.667s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:29:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1847846254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0bd289-fb74-435c-948b-906d919e4c1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e6681f1c7479a87bece5318969894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:29:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:29:59Z,use_quota=True,user_id='40e6142baa1a4d96a92f7988517d24c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Creating volume fe0bd289-fb74-435c-948b-906d919e4c1f {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:00 devstack sudo[87271]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:00 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:00 devstack sudo[87277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f 1073741824
Apr 21 02:30:00 devstack sudo[87277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.497s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:00 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ad7810ab-fa57-41ae-a290-11259b368d73 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Create snapshot completed successfully
Apr 21 02:30:00 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-faefaf11-038f-45ba-83b7-b9ba20d8e6b9 tempest-GroupsTest-949284845 None] Delete group completed successfully.
Apr 21 02:30:00 devstack sudo[87277]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f 1073741824" returned: 0 in 0.542s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:00 devstack sudo[87282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f
Apr 21 02:30:00 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Acquiring lock "cinder-d2ee92c1-c34b-461a-bb1d-0ed79768f0a3-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Flow 'volume_create_manager' (44795739-28bd-4ebc-983f-6d14a978626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96796028-e4cd-4843-a18d-1244aab75ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "cinder-d2ee92c1-c34b-461a-bb1d-0ed79768f0a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Acquiring lock "cinder-quobyte-62c739f9-97b2-4e63-b6b2-da301005641e" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96796028-e4cd-4843-a18d-1244aab75ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-179327928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78534e30-216d-43a1-bcf0-7b81a4241d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a421e82dfb475cb3bf7e5371d9ef10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:01Z,use_quota=True,user_id='a7bb4bd3fd1640549626126b64b05818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e00c638-8f01-48ab-92ab-46b60895e588),volume_type_id=3e00c638-8f01-48ab-92ab-46b60895e588)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6a66f5-f634-4318-a090-ba53316b5c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc6a66f5-f634-4318-a090-ba53316b5c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67dca3bb-5e80-419e-bcd7-54cc7657ec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67dca3bb-5e80-419e-bcd7-54cc7657ec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78534e30-216d-43a1-bcf0-7b81a4241d04', 'volume_name': 'volume-78534e30-216d-43a1-bcf0-7b81a4241d04', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d2e4c9-7c06-4f9f-a89d-ef0e4382f35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d2e4c9-7c06-4f9f-a89d-ef0e4382f35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70240dc-3eac-45b9-a6b9-9e96d0344bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:01 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Volume 78534e30-216d-43a1-bcf0-7b81a4241d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78534e30-216d-43a1-bcf0-7b81a4241d04', 'volume_size': 1}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "cinder-quobyte-62c739f9-97b2-4e63-b6b2-da301005641e" acquired by "delete_snapshot" :: waited 0.043s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Acquiring lock "cinder-quobyte-d2ee92c1-c34b-461a-bb1d-0ed79768f0a3" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "cinder-quobyte-d2ee92c1-c34b-461a-bb1d-0ed79768f0a3" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Deleting offline snapshot d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 of volume 62c739f9-97b2-4e63-b6b2-da301005641e {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] snapshot_file for this snap is: volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fabf2ef-f244-4e2e-8a95-6ab3b73c3296]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:01 devstack sudo[87285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3
Apr 21 02:30:01 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:01 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f" returned: 0 in 0.566s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.204s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-179327928',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78534e30-216d-43a1-bcf0-7b81a4241d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99a421e82dfb475cb3bf7e5371d9ef10',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:01Z,use_quota=True,user_id='a7bb4bd3fd1640549626126b64b05818',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e00c638-8f01-48ab-92ab-46b60895e588),volume_type_id=3e00c638-8f01-48ab-92ab-46b60895e588)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Creating volume 78534e30-216d-43a1-bcf0-7b81a4241d04 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:01 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f71b75f-4f94-4871-81d2-bdb5f7a897e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0bd289-fb74-435c-948b-906d919e4c1f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:01 devstack sudo[87288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04 1073741824
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09fbc4a8-c4c0-4606-849e-aeea44b8324c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:01 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:01 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Volume volume-fe0bd289-fb74-435c-948b-906d919e4c1f (fe0bd289-fb74-435c-948b-906d919e4c1f): created successfully
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09fbc4a8-c4c0-4606-849e-aeea44b8324c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Flow 'volume_create_manager' (c60a7b1e-2f45-4b44-88eb-c6f53f87e34c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:01 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d79faac2-8675-4875-923f-aa7e820f89e1 tempest-VolumesDeleteCascade-1256140931 None] Created volume successfully.
Apr 21 02:30:01 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3" returned: 0 in 0.555s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62c739f9-97b2-4e63-b6b2-da301005641e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[578f89b7-2d97-42ea-b458-ebfbcabd33e1]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:02 devstack sudo[87293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e
Apr 21 02:30:02 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:02 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04 1073741824" returned: 0 in 0.596s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:02 devstack sudo[87298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04
Apr 21 02:30:02 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:02 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e" returned: 0 in 0.634s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:02 devstack sudo[87304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3
Apr 21 02:30:02 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:02 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04" returned: 0 in 0.528s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.157s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f70240dc-3eac-45b9-a6b9-9e96d0344bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78534e30-216d-43a1-bcf0-7b81a4241d04', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db6b0e8-da9b-49e1-b786-b36e291c2a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:02 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Volume volume-78534e30-216d-43a1-bcf0-7b81a4241d04 (78534e30-216d-43a1-bcf0-7b81a4241d04): created successfully
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db6b0e8-da9b-49e1-b786-b36e291c2a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Flow 'volume_create_manager' (44795739-28bd-4ebc-983f-6d14a978626a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:02 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-cd26fa12-21af-4eae-a124-f8dc51677fef tempest-VolumeTypesAccessTest-1297712713 None] Created volume successfully.
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] Creating offline snapshot fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 of volume fe0bd289-fb74-435c-948b-906d919e4c1f {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a721d37e-b176-4ea9-bd92-cacf667e9637]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:02 devstack sudo[87306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f
Apr 21 02:30:02 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_service.periodic_task [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82686) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:02 devstack sudo[87310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:02 devstack sudo[87310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:03 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3" returned: 0 in 0.499s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:03 devstack sudo[87313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3
Apr 21 02:30:03 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:03 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f" returned: 0 in 0.624s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:03 devstack sudo[87319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 1G
Apr 21 02:30:03 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Acquiring lock "cinder-78534e30-216d-43a1-bcf0-7b81a4241d04-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:03 devstack sudo[87310]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Lock "cinder-78534e30-216d-43a1-bcf0-7b81a4241d04-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.541s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Acquiring lock "cinder-quobyte-78534e30-216d-43a1-bcf0-7b81a4241d04" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Lock "cinder-quobyte-78534e30-216d-43a1-bcf0-7b81a4241d04" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8fabc9-41ec-4c7b-bf39-c0ec575f198c]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:03 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e.d2ee92c1-c34b-461a-bb1d-0ed79768f0a3" returned: 0 in 0.496s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "cinder-quobyte-d2ee92c1-c34b-461a-bb1d-0ed79768f0a3" released by "_delete_snapshot" :: held 2.245s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "cinder-quobyte-62c739f9-97b2-4e63-b6b2-da301005641e" released by "delete_snapshot" :: held 2.257s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:03 devstack sudo[87322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04
Apr 21 02:30:03 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Created reservations ['e8ff906c-bf9f-4530-95ef-7d2efbfba1d5', 'd61b2387-b2c6-4db2-a2be-a7e4f4dfc96f', '15964649-a2ac-4496-ba90-823297286b46', 'c73dd671-b869-4077-b027-619bfa6f4454'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:03 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Delete snapshot completed successfully.
Apr 21 02:30:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99019baa-346f-4af8-957f-92460cdf0487 tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "cinder-d2ee92c1-c34b-461a-bb1d-0ed79768f0a3-delete_snapshot" released by "delete_snapshot" :: held 2.385s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:04 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 1G" returned: 0 in 0.670s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0bd289-fb74-435c-948b-906d919e4c1f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:04 devstack sudo[87330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0bd289-fb74-435c-948b-906d919e4c1f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1
Apr 21 02:30:04 devstack sudo[87330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:04 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04" returned: 0 in 0.563s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:04 devstack sudo[87332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04
Apr 21 02:30:04 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Acquiring lock "cinder-62c739f9-97b2-4e63-b6b2-da301005641e-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "cinder-62c739f9-97b2-4e63-b6b2-da301005641e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Acquiring lock "cinder-quobyte-62c739f9-97b2-4e63-b6b2-da301005641e" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:04 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-78534e30-216d-43a1-bcf0-7b81a4241d04" returned: 0 in 0.428s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "cinder-quobyte-62c739f9-97b2-4e63-b6b2-da301005641e" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Lock "cinder-quobyte-78534e30-216d-43a1-bcf0-7b81a4241d04" released by "delete_volume" :: held 1.044s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71da9a3-8601-4c32-90ac-9c86568b8f56]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:04 devstack cinder-volume[82686]: WARNING cinder.quota [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1851860244 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1851860244, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:30:04 devstack cinder-volume[82686]: WARNING cinder.quota [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1851860244 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1851860244, it is now deprecated. Please use the default quota class for default quota.
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Created reservations ['6df754e2-9512-4c2f-8fc7-4ea2e7e086a3', 'a492626d-d697-43b8-9c5d-e41f9bf97d8d', 'af2eb219-38a0-4cdb-bfb2-79e98e2db0e9', '8cf15f63-1a71-4028-ae5d-d36193fad728'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:04 devstack sudo[87338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e
Apr 21 02:30:04 devstack sudo[87338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:04 devstack sudo[87330]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0bd289-fb74-435c-948b-906d919e4c1f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1" returned: 0 in 0.641s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:04 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 is being set with open permissions: ugo+rw
Apr 21 02:30:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:04 devstack sudo[87340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:04 devstack sudo[87340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:04 devstack sudo[87341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1
Apr 21 02:30:04 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:05 devstack sudo[87338]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:05 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1" returned: 0 in 0.470s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e" returned: 0 in 0.621s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:05 devstack sudo[87349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e
Apr 21 02:30:05 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:05 devstack sudo[87351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.info
Apr 21 02:30:05 devstack sudo[87351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:05 devstack sudo[87340]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.572s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:05 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Deleted volume successfully.
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-57a6d737-22b3-4909-804d-62d7fab93849 tempest-VolumeTypesAccessTest-1297712713 None] Lock "cinder-78534e30-216d-43a1-bcf0-7b81a4241d04-delete_volume" released by "delete_volume" :: held 1.810s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:05 devstack sudo[87351]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.info" returned: 0 in 0.460s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:05 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.info is being set with open permissions: ugo+rw
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:05 devstack sudo[87355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.info
Apr 21 02:30:05 devstack sudo[87355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:05 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-62c739f9-97b2-4e63-b6b2-da301005641e" returned: 0 in 0.549s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "cinder-quobyte-62c739f9-97b2-4e63-b6b2-da301005641e" released by "delete_volume" :: held 1.209s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Created reservations ['b6c35351-a54f-4d55-ab81-1f2144d0987b', '409b741c-c2db-4643-9613-68779c93da9e', '99809bac-f0d6-45e1-99cc-82718b123527', '2d51967d-bac3-478a-ae01-2cb2ff9d2e22'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:05 devstack sudo[87357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:05 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:06 devstack sudo[87355]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.info" returned: 0 in 0.536s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.483s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:06 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d2bf1b50-2446-4d97-9479-1245570a0ed9 tempest-VolumesDeleteCascade-1256140931 None] Create snapshot completed successfully
Apr 21 02:30:06 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.517s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:06 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:06 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Deleted volume successfully.
Apr 21 02:30:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c26c6518-f251-4caf-b817-c8760d82a46e tempest-VolumeSnapshotQuotasNegativeTestJSON-725770 None] Lock "cinder-62c739f9-97b2-4e63-b6b2-da301005641e-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] Creating offline snapshot 180f9f49-d923-4595-88b6-b568437b4d44 of volume fe0bd289-fb74-435c-948b-906d919e4c1f {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:30:07 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[33838f62-0eb0-4085-ae31-0ea5f570337c]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:07 devstack sudo[87361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1
Apr 21 02:30:07 devstack sudo[87361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:07 devstack sudo[87361]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1" returned: 0 in 0.634s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe0bd289-fb74-435c-948b-906d919e4c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:07 devstack sudo[87366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44 1G
Apr 21 02:30:07 devstack sudo[87366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:08 devstack sudo[87366]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44 1G" returned: 0 in 0.664s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:08 devstack sudo[87371]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44
Apr 21 02:30:08 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Flow 'volume_create_manager' (96847434-b2d0-4c8a-ad20-e6a3dc0b6857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b517c7b8-946c-45df-a9d1-0e9c763d5dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b517c7b8-946c-45df-a9d1-0e9c763d5dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1889859509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27be326e-85b6-4b05-9948-0a456011012f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e369eaf46e4d4e7287c2e2ba0468ed13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:08Z,use_quota=True,user_id='9d53ca15b93f43dfb16f421b1527e756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb60140c-53ca-415f-9059-aea88b91d0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb60140c-53ca-415f-9059-aea88b91d0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0585966e-ee6f-4cac-88d4-70d872ada2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0585966e-ee6f-4cac-88d4-70d872ada2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27be326e-85b6-4b05-9948-0a456011012f', 'volume_name': 'volume-27be326e-85b6-4b05-9948-0a456011012f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd30a0e-af3a-465c-a4b3-8329d24574e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd30a0e-af3a-465c-a4b3-8329d24574e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3f949a-c4a1-4c2f-b491-0e937490df45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:08 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Volume 27be326e-85b6-4b05-9948-0a456011012f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27be326e-85b6-4b05-9948-0a456011012f', 'volume_size': 1}
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:08 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44" returned: 0 in 0.491s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:08 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44 is being set with open permissions: ugo+rw
Apr 21 02:30:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:08 devstack sudo[87376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44
Apr 21 02:30:08 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:09 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44" returned: 0 in 0.484s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.339s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.837s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1889859509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27be326e-85b6-4b05-9948-0a456011012f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e369eaf46e4d4e7287c2e2ba0468ed13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:08Z,use_quota=True,user_id='9d53ca15b93f43dfb16f421b1527e756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Creating volume 27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:09 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:09 devstack sudo[87379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f 1073741824
Apr 21 02:30:09 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:09 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-7525ad65-fb46-4b6c-afd1-22bee0ce9bf4 tempest-VolumesDeleteCascade-1256140931 None] Create snapshot completed successfully
Apr 21 02:30:09 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f 1073741824" returned: 0 in 0.556s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:09 devstack sudo[87384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f
Apr 21 02:30:09 devstack sudo[87384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-fe0bd289-fb74-435c-948b-906d919e4c1f-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-fe0bd289-fb74-435c-948b-906d919e4c1f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Performing cascade delete. {{(pid=82686) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-180f9f49-d923-4595-88b6-b568437b4d44-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-180f9f49-d923-4595-88b6-b568437b4d44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-quobyte-fe0bd289-fb74-435c-948b-906d919e4c1f" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-fe0bd289-fb74-435c-948b-906d919e4c1f" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-quobyte-180f9f49-d923-4595-88b6-b568437b4d44" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-180f9f49-d923-4595-88b6-b568437b4d44" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Deleting offline snapshot 180f9f49-d923-4595-88b6-b568437b4d44 of volume fe0bd289-fb74-435c-948b-906d919e4c1f {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] snapshot_file for this snap is: volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b70be96-9830-4f7b-8b16-15dfa2ed6b95]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:10 devstack sudo[87387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44
Apr 21 02:30:10 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:10 devstack sudo[87384]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f" returned: 0 in 0.525s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] <== create_volume: return (1107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf3f949a-c4a1-4c2f-b491-0e937490df45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27be326e-85b6-4b05-9948-0a456011012f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b858f811-5510-4366-b575-f632e57d2e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:10 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Volume volume-27be326e-85b6-4b05-9948-0a456011012f (27be326e-85b6-4b05-9948-0a456011012f): created successfully
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b858f811-5510-4366-b575-f632e57d2e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Flow 'volume_create_manager' (96847434-b2d0-4c8a-ad20-e6a3dc0b6857) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:10 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-2358d40d-310e-466f-a752-8b0968db294c tempest-SnapshotsActionsTest-1727479891 None] Created volume successfully.
Apr 21 02:30:10 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44" returned: 0 in 0.547s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe0bd289-fb74-435c-948b-906d919e4c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf13a7d-2884-4752-bdd2-4c41e9c5a0ad]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:10 devstack sudo[87392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1
Apr 21 02:30:10 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:11 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1" returned: 0 in 0.505s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe0bd289-fb74-435c-948b-906d919e4c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:11 devstack sudo[87398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44
Apr 21 02:30:11 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] Creating offline snapshot 58e7804b-d04b-4183-9f70-e8c908460987 of volume 27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:30:11 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[739e5afc-d660-424a-aad6-42a3ef3572cd]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:11 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:11 devstack sudo[87403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f
Apr 21 02:30:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44" returned: 0 in 0.534s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:11 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:11 devstack sudo[87405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44
Apr 21 02:30:11 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:12 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.180f9f49-d923-4595-88b6-b568437b4d44" returned: 0 in 0.449s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-180f9f49-d923-4595-88b6-b568437b4d44" released by "_delete_snapshot" :: held 2.094s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-fe0bd289-fb74-435c-948b-906d919e4c1f" released by "delete_snapshot" :: held 2.106s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:12 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f" returned: 0 in 0.653s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Created reservations ['cf1ef30c-1385-4ee3-b6cc-dcf1721f79e1', '674034f8-c5fb-4b8b-8a84-5457e20a857d', 'd6063339-169f-416d-bab2-58f3ffd706b0', '8d9438bb-4186-4ba6-bcce-37cca0666821'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:12 devstack sudo[87413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 1G
Apr 21 02:30:12 devstack sudo[87413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:12 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Delete snapshot completed successfully.
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-180f9f49-d923-4595-88b6-b568437b4d44-delete_snapshot" released by "delete_snapshot" :: held 2.260s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-fba98ba3-93ba-4d6f-92f5-9c08ff8510d1-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-fba98ba3-93ba-4d6f-92f5-9c08ff8510d1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-quobyte-fe0bd289-fb74-435c-948b-906d919e4c1f" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-fe0bd289-fb74-435c-948b-906d919e4c1f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-quobyte-fba98ba3-93ba-4d6f-92f5-9c08ff8510d1" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-fba98ba3-93ba-4d6f-92f5-9c08ff8510d1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Deleting offline snapshot fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 of volume fe0bd289-fb74-435c-948b-906d919e4c1f {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] snapshot_file for this snap is: volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf3a73b-918c-4bcf-ae17-08fd13caa5a5]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Flow 'volume_create_manager' (d9e7ce0b-dd3c-4e2f-b6ce-a9a6c683368c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c990294-ac41-4d89-b2f7-0866a3fb2c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:12 devstack sudo[87415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1
Apr 21 02:30:12 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c990294-ac41-4d89-b2f7-0866a3fb2c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-775667977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c8bf6b-ae96-49bd-96b0-0d914e5e5232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d8d8a41c1c42399c331c931d76f664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:13Z,use_quota=True,user_id='7298a5f872b34c12b944f36ee7e2ff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4f5272-42fe-42a7-ad6b-a0228e10a560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b4f5272-42fe-42a7-ad6b-a0228e10a560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1c7b65-4f9f-4a37-9c16-7c8f09fc0347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db1c7b65-4f9f-4a37-9c16-7c8f09fc0347) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02c8bf6b-ae96-49bd-96b0-0d914e5e5232', 'volume_name': 'volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb73f3ab-f64a-4abb-89bd-1c46469fa701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb73f3ab-f64a-4abb-89bd-1c46469fa701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457c0061-bdf4-4ccf-b46b-54f2bb0d7059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:12 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Volume 02c8bf6b-ae96-49bd-96b0-0d914e5e5232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232', 'volume_size': 1}
Apr 21 02:30:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:13 devstack sudo[87413]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 1G" returned: 0 in 0.624s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:13 devstack sudo[87422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:13 devstack sudo[87422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:13 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1" returned: 0 in 0.551s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe0bd289-fb74-435c-948b-906d919e4c1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:13 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa7f20a-cc73-4fd6-872e-7f20efe69c7b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:13 devstack sudo[87425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f
Apr 21 02:30:13 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:13 devstack sudo[87422]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.497s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:13 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 is being set with open permissions: ugo+rw
Apr 21 02:30:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:13 devstack sudo[87430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:13 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:13 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f" returned: 0 in 0.578s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:13 devstack sudo[87435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1
Apr 21 02:30:13 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:14 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.481s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:14 devstack sudo[87438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.info
Apr 21 02:30:14 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:14 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1" returned: 0 in 0.495s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:14 devstack sudo[87443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1
Apr 21 02:30:14 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:14 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.info" returned: 0 in 0.527s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:14 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.info is being set with open permissions: ugo+rw
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:14 devstack sudo[87447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.info
Apr 21 02:30:14 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:14 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f.fba98ba3-93ba-4d6f-92f5-9c08ff8510d1" returned: 0 in 0.448s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-fba98ba3-93ba-4d6f-92f5-9c08ff8510d1" released by "_delete_snapshot" :: held 2.156s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-fe0bd289-fb74-435c-948b-906d919e4c1f" released by "delete_snapshot" :: held 2.179s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Created reservations ['2da9ae89-e9ed-4cf8-878d-c3f54c2464a9', 'b116eaa4-ec38-40ab-826e-11e4f02fc6f1', 'b94e6466-9ff3-4a7a-8d35-1f0dfd2736fa', 'a289c018-a978-489e-92fc-f0225fce3cf5'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:14 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Delete snapshot completed successfully.
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-fba98ba3-93ba-4d6f-92f5-9c08ff8510d1-delete_snapshot" released by "delete_snapshot" :: held 2.283s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Snapshots deleted, issuing volume delete {{(pid=82686) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-quobyte-fe0bd289-fb74-435c-948b-906d919e4c1f" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-fe0bd289-fb74-435c-948b-906d919e4c1f" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[13108442-6831-48b5-a4c7-0143b2e9a294]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:14 devstack sudo[87449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f
Apr 21 02:30:14 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:15 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.info" returned: 0 in 0.522s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.374s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.419s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-775667977',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02c8bf6b-ae96-49bd-96b0-0d914e5e5232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d8d8a41c1c42399c331c931d76f664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:13Z,use_quota=True,user_id='7298a5f872b34c12b944f36ee7e2ff2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Creating volume 02c8bf6b-ae96-49bd-96b0-0d914e5e5232 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:15 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:15 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-fbffbf48-cab4-4299-a3ab-3a291b78f5ac tempest-SnapshotsActionsTest-1727479891 None] Create snapshot completed successfully
Apr 21 02:30:15 devstack sudo[87452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232 1073741824
Apr 21 02:30:15 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:15 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f" returned: 0 in 0.512s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:15 devstack sudo[87457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f
Apr 21 02:30:15 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:15 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232 1073741824" returned: 0 in 0.543s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:15 devstack sudo[87463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232
Apr 21 02:30:15 devstack sudo[87463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:15 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fe0bd289-fb74-435c-948b-906d919e4c1f" returned: 0 in 0.466s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-fe0bd289-fb74-435c-948b-906d919e4c1f" released by "delete_volume" :: held 1.012s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Created reservations ['e2c609c3-0e44-4189-ab5d-ec7448b65a64', '2e3a9b4f-f6b8-49c7-a3dd-0d8ddb6ebaa8', '60c14993-b828-4559-bdda-ec9f022d45ab', 'b1febe90-1405-41d8-9b5b-dd99172bde0d'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:15 devstack sudo[87465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:15 devstack sudo[87465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:16 devstack sudo[87463]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232" returned: 0 in 0.497s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457c0061-bdf4-4ccf-b46b-54f2bb0d7059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc03e1d-03af-4d9e-8a55-2f0efe85e1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:16 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Volume volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232 (02c8bf6b-ae96-49bd-96b0-0d914e5e5232): created successfully
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdc03e1d-03af-4d9e-8a55-2f0efe85e1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Flow 'volume_create_manager' (d9e7ce0b-dd3c-4e2f-b6ce-a9a6c683368c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:16 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c4965485-59d9-4b8b-acb7-1a605d24bba5 tempest-AbsoluteLimitsTests-339447831 None] Created volume successfully.
Apr 21 02:30:16 devstack sudo[87465]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.475s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:16 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Deleted volume successfully.
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-70531223-cc4c-4534-8cdf-8ef57013c155 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-fe0bd289-fb74-435c-948b-906d919e4c1f-delete_volume" released by "delete_volume" :: held 6.227s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] Creating offline snapshot e3653b98-1f3d-4d56-9c91-2aaa257c3998 of volume 27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f88b50-5e36-4a1d-a43e-a320b633ca9a]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:16 devstack sudo[87469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:16 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Flow 'volume_create_manager' (dbd998c7-f331-4526-9b47-aecbd8bb5ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a510522e-2402-440c-9869-a7a2aa2beaf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a510522e-2402-440c-9869-a7a2aa2beaf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1237670077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfe74eb-fd16-4383-8eab-377427d2d59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e6681f1c7479a87bece5318969894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:17Z,use_quota=True,user_id='40e6142baa1a4d96a92f7988517d24c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912fbc1c-9b5f-49f1-9e14-b7ba668b725f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912fbc1c-9b5f-49f1-9e14-b7ba668b725f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed481397-d9c1-4ca6-9734-709786e1b3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed481397-d9c1-4ca6-9734-709786e1b3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bfe74eb-fd16-4383-8eab-377427d2d59d', 'volume_name': 'volume-9bfe74eb-fd16-4383-8eab-377427d2d59d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2148fe-627b-40df-8d9f-8b821b8a50b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e2148fe-627b-40df-8d9f-8b821b8a50b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed4bf9d-f718-4b20-bfb5-fbd564371561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:17 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Volume 9bfe74eb-fd16-4383-8eab-377427d2d59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bfe74eb-fd16-4383-8eab-377427d2d59d', 'volume_size': 1}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Acquiring lock "cinder-02c8bf6b-ae96-49bd-96b0-0d914e5e5232-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Lock "cinder-02c8bf6b-ae96-49bd-96b0-0d914e5e5232-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Flow 'volume_create_manager' (c388925f-a17c-43f3-a25e-150fce148537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0915efaa-bdd8-492c-ad87-96e708480cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0915efaa-bdd8-492c-ad87-96e708480cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1373395201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9948ba5-30fe-449e-8923-b47f0fc3f50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22358ba30bfd40f3881987163bb5fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:17Z,use_quota=True,user_id='fc38a2aed361462a84e12d1e616d77de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a833a481-8fc1-4c8d-aabc-dcaafc0d83d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a833a481-8fc1-4c8d-aabc-dcaafc0d83d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de439df-596d-4dc1-b8ab-d849c1b06994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de439df-596d-4dc1-b8ab-d849c1b06994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9948ba5-30fe-449e-8923-b47f0fc3f50f', 'volume_name': 'volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a423ce-648f-412b-b726-81351c64f089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a423ce-648f-412b-b726-81351c64f089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1817ef3-60d0-480e-872b-a1f54606e86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:17 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Volume a9948ba5-30fe-449e-8923-b47f0fc3f50f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f', 'volume_size': 1}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Acquiring lock "cinder-quobyte-02c8bf6b-ae96-49bd-96b0-0d914e5e5232" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Lock "cinder-quobyte-02c8bf6b-ae96-49bd-96b0-0d914e5e5232" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd06a8f-d101-4e8b-9713-bffa4dd54cd7]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:17 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.584s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:17 devstack sudo[87476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998 1G
Apr 21 02:30:17 devstack sudo[87476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:17 devstack sudo[87475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232
Apr 21 02:30:17 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:17 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232" returned: 0 in 0.498s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:17 devstack sudo[87476]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998 1G" returned: 0 in 0.488s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:17 devstack sudo[87485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232
Apr 21 02:30:17 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:17 devstack sudo[87486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998
Apr 21 02:30:17 devstack sudo[87486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:18 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-02c8bf6b-ae96-49bd-96b0-0d914e5e5232" returned: 0 in 0.418s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Lock "cinder-quobyte-02c8bf6b-ae96-49bd-96b0-0d914e5e5232" released by "delete_volume" :: held 0.941s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:18 devstack sudo[87486]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998" returned: 0 in 0.452s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:18 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998 is being set with open permissions: ugo+rw
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:18 devstack sudo[87493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Created reservations ['f8e47edb-443c-439f-b5c2-9ec632efb11d', '3027e906-8770-49d1-af6f-7d805fd211e9', 'ecd860d3-f32d-4211-859e-aa74bd9f5e66', '26ea732b-3e40-4d5d-9028-5f89617742e2'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:18 devstack sudo[87493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:18 devstack sudo[87495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:18 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:18 devstack sudo[87493]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998" returned: 0 in 0.410s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.013s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.533s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1237670077',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bfe74eb-fd16-4383-8eab-377427d2d59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e6681f1c7479a87bece5318969894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:17Z,use_quota=True,user_id='40e6142baa1a4d96a92f7988517d24c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Creating volume 9bfe74eb-fd16-4383-8eab-377427d2d59d {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:18 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:18 devstack sudo[87499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d 1073741824
Apr 21 02:30:18 devstack sudo[87499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:18 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-18da8053-47e6-4d35-a8fe-b70a2d486bea tempest-SnapshotsActionsTest-1727479891 None] Create snapshot completed successfully
Apr 21 02:30:18 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.427s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:18 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Deleted volume successfully.
Apr 21 02:30:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d205d158-a030-41b2-9499-d5591fd9e79c tempest-AbsoluteLimitsTests-339447831 None] Lock "cinder-02c8bf6b-ae96-49bd-96b0-0d914e5e5232-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:19 devstack sudo[87499]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d 1073741824" returned: 0 in 0.498s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:19 devstack sudo[87504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d
Apr 21 02:30:19 devstack sudo[87504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:19 devstack sudo[87504]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d" returned: 0 in 0.433s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.411s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1373395201',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9948ba5-30fe-449e-8923-b47f0fc3f50f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22358ba30bfd40f3881987163bb5fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:17Z,use_quota=True,user_id='fc38a2aed361462a84e12d1e616d77de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Creating volume a9948ba5-30fe-449e-8923-b47f0fc3f50f {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:19 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed4bf9d-f718-4b20-bfb5-fbd564371561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bfe74eb-fd16-4383-8eab-377427d2d59d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:19 devstack sudo[87507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f 1073741824
Apr 21 02:30:19 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8c817e-a2a6-412f-9fb8-f8212702a582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:19 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Volume volume-9bfe74eb-fd16-4383-8eab-377427d2d59d (9bfe74eb-fd16-4383-8eab-377427d2d59d): created successfully
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d8c817e-a2a6-412f-9fb8-f8212702a582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Flow 'volume_create_manager' (dbd998c7-f331-4526-9b47-aecbd8bb5ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:19 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-fc441f90-f672-4094-a651-981579d23c04 tempest-VolumesDeleteCascade-1256140931 None] Created volume successfully.
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-e3653b98-1f3d-4d56-9c91-2aaa257c3998-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-e3653b98-1f3d-4d56-9c91-2aaa257c3998-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-quobyte-e3653b98-1f3d-4d56-9c91-2aaa257c3998" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-e3653b98-1f3d-4d56-9c91-2aaa257c3998" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Deleting offline snapshot e3653b98-1f3d-4d56-9c91-2aaa257c3998 of volume 27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] snapshot_file for this snap is: volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[2851da61-3cd5-4eea-8a7c-fd9247df120b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:20 devstack sudo[87509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998
Apr 21 02:30:20 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:20 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f 1073741824" returned: 0 in 0.555s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:20 devstack sudo[87514]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f
Apr 21 02:30:20 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:20 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998" returned: 0 in 0.535s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[175a53d2-bce9-4cd1-919c-8154f379dcd7]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:20 devstack sudo[87519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:20 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:20 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f" returned: 0 in 0.518s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.413s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1817ef3-60d0-480e-872b-a1f54606e86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e570ad7e-ba9a-4cd3-b3f9-c98c40d37f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:20 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Volume volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f (a9948ba5-30fe-449e-8923-b47f0fc3f50f): created successfully
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e570ad7e-ba9a-4cd3-b3f9-c98c40d37f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Flow 'volume_create_manager' (c388925f-a17c-43f3-a25e-150fce148537) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] Creating offline snapshot b678ff82-9298-4e32-bf1c-dcd2e88fafe1 of volume 9bfe74eb-fd16-4383-8eab-377427d2d59d {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:30:20 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-22ad856b-9383-488f-a75c-68e3580965f9 tempest-VolumesListAdminTestJSON-419583830 None] Created volume successfully.
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[017fd134-b00b-4eed-9f7c-e8c0fcc0df90]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:20 devstack sudo[87522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d
Apr 21 02:30:20 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:21 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.556s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:21 devstack sudo[87527]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998
Apr 21 02:30:21 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:21 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d" returned: 0 in 0.553s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:21 devstack sudo[87533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1 1G
Apr 21 02:30:21 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:21 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998" returned: 0 in 0.576s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:21 devstack sudo[87538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998
Apr 21 02:30:21 devstack sudo[87538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Flow 'volume_create_manager' (ae05dc33-4294-471e-ae43-c6dae35a8d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b055bc-e59c-41a8-8fd0-add3aa941228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b055bc-e59c-41a8-8fd0-add3aa941228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-168954570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5351aca9-7559-4d68-be8c-648b28e737ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22358ba30bfd40f3881987163bb5fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:22Z,use_quota=True,user_id='fc38a2aed361462a84e12d1e616d77de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520e40d1-ea8f-4b9f-8663-0f1f452e7a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520e40d1-ea8f-4b9f-8663-0f1f452e7a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ff04a2-69f0-4ed6-a76d-810c029b86ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ff04a2-69f0-4ed6-a76d-810c029b86ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5351aca9-7559-4d68-be8c-648b28e737ab', 'volume_name': 'volume-5351aca9-7559-4d68-be8c-648b28e737ab', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729a4b3c-3312-4052-9a8d-28a718a29993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (729a4b3c-3312-4052-9a8d-28a718a29993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55085d7d-0dc5-43f7-8b7a-b2a422df405d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:21 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Volume 5351aca9-7559-4d68-be8c-648b28e737ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5351aca9-7559-4d68-be8c-648b28e737ab', 'volume_size': 1}
Apr 21 02:30:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:22 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1 1G" returned: 0 in 0.615s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bfe74eb-fd16-4383-8eab-377427d2d59d -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:22 devstack sudo[87544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bfe74eb-fd16-4383-8eab-377427d2d59d -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1
Apr 21 02:30:22 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:22 devstack sudo[87538]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e3653b98-1f3d-4d56-9c91-2aaa257c3998" returned: 0 in 0.453s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-e3653b98-1f3d-4d56-9c91-2aaa257c3998" released by "_delete_snapshot" :: held 2.179s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" released by "delete_snapshot" :: held 2.195s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:22 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Created reservations ['7a95362f-7480-43bc-8904-a4359c342be8', '93f3b712-3193-40bd-b14b-1786fd5c1324', '6acd7bc1-18f0-4cb2-a293-dd8498963ab8', 'f5e85665-4875-4e1f-beeb-ed25c86b4b02'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:22 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Delete snapshot completed successfully.
Apr 21 02:30:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f22f14bc-ad81-4acd-8dff-8dccce7958fa tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-e3653b98-1f3d-4d56-9c91-2aaa257c3998-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:22 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9bfe74eb-fd16-4383-8eab-377427d2d59d -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1" returned: 0 in 0.538s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:22 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1 is being set with open permissions: ugo+rw
Apr 21 02:30:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:22 devstack sudo[87549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1
Apr 21 02:30:22 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:23 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1" returned: 0 in 0.460s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:23 devstack sudo[87552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.info
Apr 21 02:30:23 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Flow 'volume_create_manager' (2f53ee11-9d92-4e21-98b0-540876e92783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a908054-4bf6-4844-8207-d48811651f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a908054-4bf6-4844-8207-d48811651f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-865168528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3b9886-4ed2-4241-865f-89e2bc7a331e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0f18e1bb27649b1b9edba1282c34151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:23Z,use_quota=True,user_id='4a831cd89db242d6abfa66304ecf599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4afdc2-4de2-4d30-a1ca-d5e426f3c319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e4afdc2-4de2-4d30-a1ca-d5e426f3c319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8207434-7d61-483f-a5a2-3b8dc33f0919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8207434-7d61-483f-a5a2-3b8dc33f0919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da3b9886-4ed2-4241-865f-89e2bc7a331e', 'volume_name': 'volume-da3b9886-4ed2-4241-865f-89e2bc7a331e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5d17fe-8499-4a19-9ccd-ba7332125482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c5d17fe-8499-4a19-9ccd-ba7332125482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367fcb38-5f3c-4248-ad1f-b089c87560e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:23 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Volume da3b9886-4ed2-4241-865f-89e2bc7a331e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da3b9886-4ed2-4241-865f-89e2bc7a331e', 'volume_size': 1}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:23 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.info" returned: 0 in 0.494s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:23 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.info is being set with open permissions: ugo+rw
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:23 devstack sudo[87555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.info
Apr 21 02:30:23 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:23 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.info" returned: 0 in 0.416s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.179s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.192s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-168954570',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5351aca9-7559-4d68-be8c-648b28e737ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22358ba30bfd40f3881987163bb5fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:22Z,use_quota=True,user_id='fc38a2aed361462a84e12d1e616d77de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Creating volume 5351aca9-7559-4d68-be8c-648b28e737ab {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:23 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:24 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d27d29f6-7fc2-49f3-bab3-14df39e3ffd2 tempest-VolumesDeleteCascade-1256140931 None] Create snapshot completed successfully
Apr 21 02:30:24 devstack sudo[87558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab 1073741824
Apr 21 02:30:24 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:24 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab 1073741824" returned: 0 in 0.535s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:24 devstack sudo[87563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab
Apr 21 02:30:24 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Flow 'volume_create_manager' (d0a5e5e4-c6eb-42fe-a71f-911e1d944fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c798d424-8ce2-4428-b9f9-881e6d7653f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c798d424-8ce2-4428-b9f9-881e6d7653f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-218070918',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d34873d-55a8-4ba4-a0a7-c67f876df653,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775e6681f1c7479a87bece5318969894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b678ff82-9298-4e32-bf1c-dcd2e88fafe1,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:25Z,use_quota=True,user_id='40e6142baa1a4d96a92f7988517d24c3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683c0271-c743-4537-b71d-d8ac0a746f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (683c0271-c743-4537-b71d-d8ac0a746f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74124cda-3112-48e4-a990-b9ff8775e03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74124cda-3112-48e4-a990-b9ff8775e03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6d34873d-55a8-4ba4-a0a7-c67f876df653', 'volume_name': 'volume-6d34873d-55a8-4ba4-a0a7-c67f876df653', 'volume_size': 1, 'snapshot_id': 'b678ff82-9298-4e32-bf1c-dcd2e88fafe1'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fb78e7-01dd-4be4-804f-3ad8243749bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62fb78e7-01dd-4be4-804f-3ad8243749bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983f72f2-6262-43b2-8560-1faee641fa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:24 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Volume 6d34873d-55a8-4ba4-a0a7-c67f876df653: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6d34873d-55a8-4ba4-a0a7-c67f876df653', 'volume_size': 1, 'snapshot_id': 'b678ff82-9298-4e32-bf1c-dcd2e88fafe1'}
Apr 21 02:30:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:25 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab" returned: 0 in 0.424s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.665s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55085d7d-0dc5-43f7-8b7a-b2a422df405d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5351aca9-7559-4d68-be8c-648b28e737ab', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f78233-8b0b-4fe1-a828-a81f9cd9c4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:25 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Volume volume-5351aca9-7559-4d68-be8c-648b28e737ab (5351aca9-7559-4d68-be8c-648b28e737ab): created successfully
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f78233-8b0b-4fe1-a828-a81f9cd9c4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Flow 'volume_create_manager' (ae05dc33-4294-471e-ae43-c6dae35a8d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] Creating offline snapshot 200b013f-b21a-45f2-8050-f250eb2d5db7 of volume 27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:30:25 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-26f97e29-a9ea-47fa-845f-28d2f4cbe5a0 tempest-VolumesListAdminTestJSON-419583830 None] Created volume successfully.
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9687adf4-31dc-4ea8-b0f0-65f72dc35bd1]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:25 devstack sudo[87566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:25 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:25 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.460s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:25 devstack sudo[87571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7 1G
Apr 21 02:30:25 devstack sudo[87571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:26 devstack sudo[87571]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7 1G" returned: 0 in 0.506s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:26 devstack sudo[87576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7
Apr 21 02:30:26 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Flow 'volume_create_manager' (81084eb2-5903-4afb-aa5d-2c763a92befd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d415adb5-a264-40e8-85bd-fc7230fc1202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d415adb5-a264-40e8-85bd-fc7230fc1202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1850154759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9b1698-6fd3-4e79-a667-d38229327c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22358ba30bfd40f3881987163bb5fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:26Z,use_quota=True,user_id='fc38a2aed361462a84e12d1e616d77de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f38ae1-6729-461a-9910-a7e9db43db21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f38ae1-6729-461a-9910-a7e9db43db21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7c9e62-ed63-4df1-ae5b-4f0201fe6b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7c9e62-ed63-4df1-ae5b-4f0201fe6b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c9b1698-6fd3-4e79-a667-d38229327c1b', 'volume_name': 'volume-6c9b1698-6fd3-4e79-a667-d38229327c1b', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e828a2-f49a-4082-b77e-029a04fdcddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e828a2-f49a-4082-b77e-029a04fdcddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0143b5e-fda2-4c10-911f-52a6fc3df7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:26 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Volume 6c9b1698-6fd3-4e79-a667-d38229327c1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c9b1698-6fd3-4e79-a667-d38229327c1b', 'volume_size': 1}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:26 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7" returned: 0 in 0.482s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:26 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7 is being set with open permissions: ugo+rw
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:26 devstack sudo[87581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7
Apr 21 02:30:26 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:26 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7" returned: 0 in 0.410s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.574s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-865168528',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da3b9886-4ed2-4241-865f-89e2bc7a331e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0f18e1bb27649b1b9edba1282c34151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:23Z,use_quota=True,user_id='4a831cd89db242d6abfa66304ecf599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Creating volume da3b9886-4ed2-4241-865f-89e2bc7a331e {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:26 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:26 devstack sudo[87584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e 1073741824
Apr 21 02:30:26 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:26 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-8e8a2024-7159-469b-85ea-899cfe5b9394 tempest-SnapshotsActionsTest-1727479891 None] Create snapshot completed successfully
Apr 21 02:30:27 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e 1073741824" returned: 0 in 0.483s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:27 devstack sudo[87589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e
Apr 21 02:30:27 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-200b013f-b21a-45f2-8050-f250eb2d5db7-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-200b013f-b21a-45f2-8050-f250eb2d5db7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-quobyte-200b013f-b21a-45f2-8050-f250eb2d5db7" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-200b013f-b21a-45f2-8050-f250eb2d5db7" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Deleting offline snapshot 200b013f-b21a-45f2-8050-f250eb2d5db7 of volume 27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] snapshot_file for this snap is: volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7f2e6c-bc53-47c8-adaa-e20658858e5f]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:27 devstack sudo[87591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7
Apr 21 02:30:27 devstack sudo[87591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:27 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e" returned: 0 in 0.439s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.018s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-quobyte-b678ff82-9298-4e32-bf1c-dcd2e88fafe1-6d34873d-55a8-4ba4-a0a7-c67f876df653" by "_create_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367fcb38-5f3c-4248-ad1f-b089c87560e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da3b9886-4ed2-4241-865f-89e2bc7a331e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881fcd1d-7761-4f18-97db-5eebb2713cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:27 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Volume volume-da3b9886-4ed2-4241-865f-89e2bc7a331e (da3b9886-4ed2-4241-865f-89e2bc7a331e): created successfully
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881fcd1d-7761-4f18-97db-5eebb2713cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Flow 'volume_create_manager' (2f53ee11-9d92-4e21-98b0-540876e92783) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-b678ff82-9298-4e32-bf1c-dcd2e88fafe1-6d34873d-55a8-4ba4-a0a7-c67f876df653" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Creating volume 6d34873d-55a8-4ba4-a0a7-c67f876df653 from snapshot b678ff82-9298-4e32-bf1c-dcd2e88fafe1 {{(pid=82686) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-quobyte-6d34873d-55a8-4ba4-a0a7-c67f876df653" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:27 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-a21d4b68-2c64-4d9c-a234-c6b1e74fc773 tempest-VolumesListTestJSON-1881435685 None] Created volume successfully.
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-6d34873d-55a8-4ba4-a0a7-c67f876df653" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] snapshot: b678ff82-9298-4e32-bf1c-dcd2e88fafe1, volume: 6d34873d-55a8-4ba4-a0a7-c67f876df653,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:27 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[5522c7b0-f0f9-4040-8ece-d33ed7ef8da4]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:28 devstack sudo[87591]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7" returned: 0 in 0.486s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:28 devstack sudo[87597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1
Apr 21 02:30:28 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0524c03-0328-4d36-8dd1-1de7eae5319f]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:28 devstack sudo[87599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:28 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:28 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1" returned: 0 in 0.469s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bfe74eb-fd16-4383-8eab-377427d2d59d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7f9552-7857-4287-aedb-77fdb03fbb36]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:28 devstack sudo[87607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d
Apr 21 02:30:28 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:28 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.497s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:28 devstack sudo[87609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7
Apr 21 02:30:28 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Flow 'volume_create_manager' (cad6656a-2b91-4684-9b57-a83456a64e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339011e4-eba4-471e-9c95-e1786872222f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339011e4-eba4-471e-9c95-e1786872222f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-878604884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8686718-b00d-4eff-aeec-d5a81c3a28a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0f18e1bb27649b1b9edba1282c34151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:29Z,use_quota=True,user_id='4a831cd89db242d6abfa66304ecf599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02cab6b-5bdf-41f9-871a-ec74c7fc478d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c02cab6b-5bdf-41f9-871a-ec74c7fc478d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3804a7da-3fe9-44eb-be37-1634a5ddb66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3804a7da-3fe9-44eb-be37-1634a5ddb66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8686718-b00d-4eff-aeec-d5a81c3a28a2', 'volume_name': 'volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca8996b-6310-4a77-bbc9-d35b185ebee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ca8996b-6310-4a77-bbc9-d35b185ebee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f1f637-5424-4c7b-9a80-5ccf1d6ed1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:28 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Volume d8686718-b00d-4eff-aeec-d5a81c3a28a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2', 'volume_size': 1}
Apr 21 02:30:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:29 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d" returned: 0 in 0.533s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:29 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653 not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:30:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:29 devstack sudo[87617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653
Apr 21 02:30:29 devstack sudo[87617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:29 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7" returned: 0 in 0.554s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:29 devstack sudo[87619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7
Apr 21 02:30:29 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:29 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.200b013f-b21a-45f2-8050-f250eb2d5db7" returned: 0 in 0.865s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-200b013f-b21a-45f2-8050-f250eb2d5db7" released by "_delete_snapshot" :: held 2.461s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" released by "delete_snapshot" :: held 2.479s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:30 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Created reservations ['7ffd5884-9553-45f9-b28a-1412f8927ebd', '346e2624-5a4f-4c9f-9e9f-ceffce37e084', 'd5cefee2-3fc7-4774-b417-e9b89f2cf27f', '2e5ffef8-94f6-4e3e-a2e6-4d6b058e24f4'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:30 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Delete snapshot completed successfully.
Apr 21 02:30:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6df03002-9452-4a2b-b84a-7ef17ab013a9 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-200b013f-b21a-45f2-8050-f250eb2d5db7-delete_snapshot" released by "delete_snapshot" :: held 2.654s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:31 devstack sudo[87617]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653" returned: 0 in 2.096s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:31 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ce8a66-cba3-4e55-8d7b-02cd83a9dc84]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:31 devstack sudo[87632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d
Apr 21 02:30:31 devstack sudo[87632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:31 devstack sudo[87632]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d" returned: 0 in 0.580s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:31 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:30:31 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Converted 1024.00 MB image at 488.45 MB/s
Apr 21 02:30:31 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653 is being set with open permissions: ugo+rw
Apr 21 02:30:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:31 devstack sudo[87638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653
Apr 21 02:30:31 devstack sudo[87638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:32 devstack sudo[87638]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653" returned: 0 in 0.411s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-6d34873d-55a8-4ba4-a0a7-c67f876df653" released by "_copy_volume_from_snapshot" :: held 4.144s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-b678ff82-9298-4e32-bf1c-dcd2e88fafe1-6d34873d-55a8-4ba4-a0a7-c67f876df653" released by "_create_volume_from_snapshot" :: held 4.167s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.203s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.913s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1850154759',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c9b1698-6fd3-4e79-a667-d38229327c1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='22358ba30bfd40f3881987163bb5fea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:26Z,use_quota=True,user_id='fc38a2aed361462a84e12d1e616d77de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Creating volume 6c9b1698-6fd3-4e79-a667-d38229327c1b {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:32 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:32 devstack sudo[87641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b 1073741824
Apr 21 02:30:32 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (983f72f2-6262-43b2-8560-1faee641fa09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d34873d-55a8-4ba4-a0a7-c67f876df653', 'volume_size': 1, 'snapshot_id': 'b678ff82-9298-4e32-bf1c-dcd2e88fafe1'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e002f93f-3238-4b44-8580-7a02d90311e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:32 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Volume volume-6d34873d-55a8-4ba4-a0a7-c67f876df653 (6d34873d-55a8-4ba4-a0a7-c67f876df653): created successfully
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e002f93f-3238-4b44-8580-7a02d90311e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Flow 'volume_create_manager' (d0a5e5e4-c6eb-42fe-a71f-911e1d944fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-384949fd-b56c-46d6-a9bc-f7c3cb041ee2 tempest-VolumesDeleteCascade-1256140931 None] Created volume successfully.
Apr 21 02:30:32 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b 1073741824" returned: 0 in 0.483s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:32 devstack sudo[87646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b
Apr 21 02:30:32 devstack sudo[87646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:33 devstack sudo[87646]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b" returned: 0 in 0.428s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.178s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-878604884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8686718-b00d-4eff-aeec-d5a81c3a28a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0f18e1bb27649b1b9edba1282c34151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:29Z,use_quota=True,user_id='4a831cd89db242d6abfa66304ecf599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Creating volume d8686718-b00d-4eff-aeec-d5a81c3a28a2 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:33 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0143b5e-fda2-4c10-911f-52a6fc3df7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c9b1698-6fd3-4e79-a667-d38229327c1b', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b893304-c2a5-45c1-bb46-faf84aecf865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:33 devstack sudo[87649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2 1073741824
Apr 21 02:30:33 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:33 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Volume volume-6c9b1698-6fd3-4e79-a667-d38229327c1b (6c9b1698-6fd3-4e79-a667-d38229327c1b): created successfully
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b893304-c2a5-45c1-bb46-faf84aecf865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Flow 'volume_create_manager' (81084eb2-5903-4afb-aa5d-2c763a92befd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:33 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-59230a2c-c11f-457a-9243-fadcec289bdc tempest-VolumesListAdminTestJSON-419583830 None] Created volume successfully.
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-9bfe74eb-fd16-4383-8eab-377427d2d59d-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-9bfe74eb-fd16-4383-8eab-377427d2d59d-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Performing cascade delete. {{(pid=82686) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-b678ff82-9298-4e32-bf1c-dcd2e88fafe1-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-b678ff82-9298-4e32-bf1c-dcd2e88fafe1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-quobyte-9bfe74eb-fd16-4383-8eab-377427d2d59d" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-9bfe74eb-fd16-4383-8eab-377427d2d59d" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-quobyte-b678ff82-9298-4e32-bf1c-dcd2e88fafe1" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-b678ff82-9298-4e32-bf1c-dcd2e88fafe1" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Deleting offline snapshot b678ff82-9298-4e32-bf1c-dcd2e88fafe1 of volume 9bfe74eb-fd16-4383-8eab-377427d2d59d {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] snapshot_file for this snap is: volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[556c7999-c066-426c-9577-b7df593b6b82]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:33 devstack sudo[87651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1
Apr 21 02:30:33 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:33 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2 1073741824" returned: 0 in 0.607s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:33 devstack sudo[87657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2
Apr 21 02:30:33 devstack sudo[87657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:33 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Flow 'volume_create_manager' (1cd6c14d-bcb8-4c54-9fd0-0358e3bf9c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02f4a83-7af6-456a-a305-8de0bab67d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d02f4a83-7af6-456a-a305-8de0bab67d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf737ea1-a64c-4067-b51b-82cf2ad0c3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb348c0c3644fa1a8c3614b6cae47db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:34Z,use_quota=True,user_id='05d01d2eeac64693b64770427969c039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cf4a6f-bf4f-4d25-8076-3e8d1bc880bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81cf4a6f-bf4f-4d25-8076-3e8d1bc880bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ebfe8a-4828-414a-9010-cc6af87eef64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ebfe8a-4828-414a-9010-cc6af87eef64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf737ea1-a64c-4067-b51b-82cf2ad0c3b2', 'volume_name': 'volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f160ab-ed96-47a1-9eb0-1a3a80800d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87f160ab-ed96-47a1-9eb0-1a3a80800d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4174c8e-b036-4d61-b5b6-7a043ef6c09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:34 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Volume bf737ea1-a64c-4067-b51b-82cf2ad0c3b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2', 'volume_size': 1}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1" returned: 0 in 0.588s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9bfe74eb-fd16-4383-8eab-377427d2d59d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c89b2d8-0421-48c6-b8fd-e034af5991ae]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:34 devstack sudo[87662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d
Apr 21 02:30:34 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:34 devstack sudo[87657]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2" returned: 0 in 0.473s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.096s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f1f637-5424-4c7b-9a80-5ccf1d6ed1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ce4d98-4a74-4ac3-8bbd-990bc938bf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] Creating offline snapshot e7394356-c239-4715-a082-6cdb8ddef236 of volume 27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:30:34 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Volume volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2 (d8686718-b00d-4eff-aeec-d5a81c3a28a2): created successfully
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76ce4d98-4a74-4ac3-8bbd-990bc938bf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Flow 'volume_create_manager' (cad6656a-2b91-4684-9b57-a83456a64e2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[18418ec8-2861-4679-afda-7220cdf2c6f7]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:34 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-3e33b547-0119-4b67-baa6-54c210a43c2a tempest-VolumesListTestJSON-1881435685 None] Created volume successfully.
Apr 21 02:30:34 devstack sudo[87665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:34 devstack sudo[87665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:34 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d" returned: 0 in 0.496s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:34 devstack sudo[87670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1
Apr 21 02:30:34 devstack sudo[87670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:34 devstack sudo[87665]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.481s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:34 devstack sudo[87675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236 1G
Apr 21 02:30:34 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:35 devstack sudo[87670]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1" returned: 0 in 0.489s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:35 devstack sudo[87680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1
Apr 21 02:30:35 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:35 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236 1G" returned: 0 in 0.491s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:35 devstack sudo[87685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236
Apr 21 02:30:35 devstack sudo[87685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:35 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d.b678ff82-9298-4e32-bf1c-dcd2e88fafe1" returned: 0 in 0.468s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-b678ff82-9298-4e32-bf1c-dcd2e88fafe1" released by "_delete_snapshot" :: held 2.083s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-9bfe74eb-fd16-4383-8eab-377427d2d59d" released by "delete_snapshot" :: held 2.092s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=197,cinder:INSERT=43,cinder:UPDATE=208,cinder:DELETE=15 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Created reservations ['124995f9-0cf3-4aed-a898-49e6ef8fb3ef', 'e0e669d2-0e08-4fee-af25-72e1047bd7e5', '7899b8d6-102e-404e-9607-961d26ac46c5', '63fb5ee6-c14d-4bda-a43c-0d33d938bf9e'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:UPDATE=240,cinder:SELECT=191,cinder:INSERT=61,cinder:DELETE=19 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:30:35 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Delete snapshot completed successfully.
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Flow 'volume_create_manager' (8f8398e5-55df-4dbb-be51-9550c7a77b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c767cf81-c6da-447a-b178-d940ba70ef6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-b678ff82-9298-4e32-bf1c-dcd2e88fafe1-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Snapshots deleted, issuing volume delete {{(pid=82686) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-quobyte-9bfe74eb-fd16-4383-8eab-377427d2d59d" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c767cf81-c6da-447a-b178-d940ba70ef6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1419388030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64846717-72e8-4157-b010-cd4abca7db7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0f18e1bb27649b1b9edba1282c34151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:36Z,use_quota=True,user_id='4a831cd89db242d6abfa66304ecf599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d91ef7-5021-4a5f-a325-3871f440bc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6d91ef7-5021-4a5f-a325-3871f440bc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabca710-731c-436b-91bd-fa9db560201f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabca710-731c-436b-91bd-fa9db560201f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64846717-72e8-4157-b010-cd4abca7db7e', 'volume_name': 'volume-64846717-72e8-4157-b010-cd4abca7db7e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f137535-3393-4794-a575-90e80b7e875a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f137535-3393-4794-a575-90e80b7e875a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee36efe3-5254-4045-8ea1-0f57d678807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:35 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Volume 64846717-72e8-4157-b010-cd4abca7db7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64846717-72e8-4157-b010-cd4abca7db7e', 'volume_size': 1}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-9bfe74eb-fd16-4383-8eab-377427d2d59d" acquired by "delete_volume" :: waited 0.042s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:35 devstack sudo[87685]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[1647919f-24a1-4fe9-947f-bb9ba8def0ec]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236" returned: 0 in 0.479s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:35 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236 is being set with open permissions: ugo+rw
Apr 21 02:30:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:35 devstack sudo[87692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236
Apr 21 02:30:35 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:35 devstack sudo[87691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d
Apr 21 02:30:35 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:36 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236" returned: 0 in 0.413s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.127s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf737ea1-a64c-4067-b51b-82cf2ad0c3b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb348c0c3644fa1a8c3614b6cae47db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:34Z,use_quota=True,user_id='05d01d2eeac64693b64770427969c039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Creating volume bf737ea1-a64c-4067-b51b-82cf2ad0c3b2 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:36 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:36 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d" returned: 0 in 0.465s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:36 devstack sudo[87699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2 1073741824
Apr 21 02:30:36 devstack sudo[87699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:36 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-5e3d6904-69d9-4aca-835e-f07bd0e8c5a8 tempest-SnapshotsActionsTest-1727479891 None] Create snapshot completed successfully
Apr 21 02:30:36 devstack sudo[87701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d
Apr 21 02:30:36 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-e7394356-c239-4715-a082-6cdb8ddef236-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-e7394356-c239-4715-a082-6cdb8ddef236-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-quobyte-e7394356-c239-4715-a082-6cdb8ddef236" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-e7394356-c239-4715-a082-6cdb8ddef236" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Deleting offline snapshot e7394356-c239-4715-a082-6cdb8ddef236 of volume 27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] snapshot_file for this snap is: volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb2535f-116c-43fb-9120-5f06c0b86b07]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:36 devstack sudo[87703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236
Apr 21 02:30:36 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:36 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9bfe74eb-fd16-4383-8eab-377427d2d59d" returned: 0 in 0.456s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-9bfe74eb-fd16-4383-8eab-377427d2d59d" released by "delete_volume" :: held 0.953s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Created reservations ['eaefbcf8-3c6e-4e33-9448-60c4661bc854', '2ca321b4-f710-417d-b886-72b50bddef06', '5505d782-1b60-4706-ab1a-22da7f15cb47', 'ff9793e6-0864-44cc-9f3c-b8c6cf1fadab'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:36 devstack sudo[87699]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2 1073741824" returned: 0 in 0.561s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:36 devstack sudo[87709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:36 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:36 devstack sudo[87711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2
Apr 21 02:30:36 devstack sudo[87711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:36 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236" returned: 0 in 0.514s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c45a160-c20d-435a-9d13-d916cd04ca3a]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:36 devstack sudo[87716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:36 devstack sudo[87716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:37 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.411s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:37 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Deleted volume successfully.
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61a9ad6f-5800-4786-b03b-2be332284bb4 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-9bfe74eb-fd16-4383-8eab-377427d2d59d-delete_volume" released by "delete_volume" :: held 3.813s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:37 devstack sudo[87711]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2" returned: 0 in 0.435s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.501s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1419388030',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64846717-72e8-4157-b010-cd4abca7db7e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0f18e1bb27649b1b9edba1282c34151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:36Z,use_quota=True,user_id='4a831cd89db242d6abfa66304ecf599b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Creating volume 64846717-72e8-4157-b010-cd4abca7db7e {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:37 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4174c8e-b036-4d61-b5b6-7a043ef6c09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6964589-7345-44c9-9409-381d626797a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:37 devstack sudo[87720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e 1073741824
Apr 21 02:30:37 devstack sudo[87720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:37 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Volume volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2 (bf737ea1-a64c-4067-b51b-82cf2ad0c3b2): created successfully
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6964589-7345-44c9-9409-381d626797a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Flow 'volume_create_manager' (1cd6c14d-bcb8-4c54-9fd0-0358e3bf9c20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:37 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-144d3f9a-4632-45da-9123-5d943c6b40c1 tempest-VolumesListAdminTestJSON-143420319 None] Created volume successfully.
Apr 21 02:30:37 devstack sudo[87716]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.504s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:37 devstack sudo[87725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236
Apr 21 02:30:37 devstack sudo[87725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:37 devstack sudo[87720]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e 1073741824" returned: 0 in 0.500s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:37 devstack sudo[87730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e
Apr 21 02:30:37 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-6d34873d-55a8-4ba4-a0a7-c67f876df653-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-6d34873d-55a8-4ba4-a0a7-c67f876df653-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "cinder-quobyte-6d34873d-55a8-4ba4-a0a7-c67f876df653" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-6d34873d-55a8-4ba4-a0a7-c67f876df653" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fc2285-7b41-4208-9328-518527728cef]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:37 devstack sudo[87734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653
Apr 21 02:30:37 devstack sudo[87734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:37 devstack sudo[87725]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236" returned: 0 in 0.531s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:37 devstack sudo[87737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236
Apr 21 02:30:37 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:38 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e" returned: 0 in 0.433s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee36efe3-5254-4045-8ea1-0f57d678807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64846717-72e8-4157-b010-cd4abca7db7e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7676e6-0163-4184-8edc-e1646e5d1039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:38 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Volume volume-64846717-72e8-4157-b010-cd4abca7db7e (64846717-72e8-4157-b010-cd4abca7db7e): created successfully
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7676e6-0163-4184-8edc-e1646e5d1039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Flow 'volume_create_manager' (8f8398e5-55df-4dbb-be51-9550c7a77b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:38 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-987ca8cb-ec7d-4f1e-8c4e-8a4d6fd47d80 tempest-VolumesListTestJSON-1881435685 None] Created volume successfully.
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Acquiring lock "cinder-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Lock "cinder-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Acquiring lock "cinder-quobyte-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Lock "cinder-quobyte-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2" acquired by "delete_volume" :: waited 0.025s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2aa555-c01e-4235-b83f-46be4989a82a]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "cinder-6c9b1698-6fd3-4e79-a667-d38229327c1b-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-6c9b1698-6fd3-4e79-a667-d38229327c1b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:38 devstack sudo[87734]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653" returned: 0 in 0.560s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:38 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:38 devstack sudo[87744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2
Apr 21 02:30:38 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.e7394356-c239-4715-a082-6cdb8ddef236" returned: 0 in 0.462s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:38 devstack sudo[87745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653
Apr 21 02:30:38 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-e7394356-c239-4715-a082-6cdb8ddef236" released by "_delete_snapshot" :: held 2.068s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" released by "delete_snapshot" :: held 2.083s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "cinder-quobyte-6c9b1698-6fd3-4e79-a667-d38229327c1b" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-quobyte-6c9b1698-6fd3-4e79-a667-d38229327c1b" acquired by "delete_volume" :: waited 0.015s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4f6c7d-4685-41e6-a97d-6b3caf8fe34e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Created reservations ['c95540d3-5f84-40fa-a154-44a9411ea3a1', 'f96e2bb1-4f90-4731-b5de-ad0c98e32164', 'ae4df87f-80fa-4795-ad19-d0b4a5669279', '1a0aced5-7887-4490-b2e1-06589c932698'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:38 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Delete snapshot completed successfully.
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e15823cc-1b25-421d-8b2a-67e75dae3ef1 tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-e7394356-c239-4715-a082-6cdb8ddef236-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:38 devstack sudo[87748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b
Apr 21 02:30:38 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:38 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:38 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6d34873d-55a8-4ba4-a0a7-c67f876df653" returned: 0 in 0.447s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2" returned: 0 in 0.521s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-quobyte-6d34873d-55a8-4ba4-a0a7-c67f876df653" released by "delete_volume" :: held 1.039s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:38 devstack sudo[87754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2
Apr 21 02:30:38 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Created reservations ['d1667fef-14b5-49ee-b0f7-75972271470f', '5a3ebab5-b8a6-44cf-99af-388fe0c269fb', '36306d90-cc6e-4d2c-836a-ec0681bfa8a1', 'baeb87b1-64bf-46fd-9721-5bde83b6ebe1'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:38 devstack sudo[87759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:38 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:39 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b" returned: 0 in 0.528s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:39 devstack sudo[87761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b
Apr 21 02:30:39 devstack sudo[87761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:39 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2" returned: 0 in 0.471s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Lock "cinder-quobyte-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2" released by "delete_volume" :: held 1.014s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Created reservations ['559a453d-d6be-4e58-bfce-0bcc7bb50dd4', '826341a7-3442-4190-8f35-b14d6124aed0', 'b8f1625e-453a-4cdb-98d3-e3df6ddd022c', 'fbb05e56-e0ab-4e76-b140-fd0facc6cb0a'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:39 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.436s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:39 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Deleted volume successfully.
Apr 21 02:30:39 devstack sudo[87766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:39 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ab09e8fd-2cf4-4fb4-9647-fe30d2a3d014 tempest-VolumesDeleteCascade-1256140931 None] Lock "cinder-6d34873d-55a8-4ba4-a0a7-c67f876df653-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:39 devstack sudo[87761]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-6c9b1698-6fd3-4e79-a667-d38229327c1b" returned: 0 in 0.483s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-quobyte-6c9b1698-6fd3-4e79-a667-d38229327c1b" released by "delete_volume" :: held 1.030s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Created reservations ['86eeb85b-80ff-4f0d-8418-a0ce5c038219', 'e75eb2b1-5ebc-44f1-86a2-fd1806eef919', 'ee012a7f-7545-4fa4-8d18-74893023c4bf', '961fbb67-be5c-495e-af66-47bcec744541'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:39 devstack sudo[87768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:39 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] Creating offline snapshot a67bfc4b-6612-4db8-814b-aa3299d277c6 of volume 27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[512a37ba-e3ee-458e-9c3d-1db47c642db0]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:39 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.479s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:39 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Deleted volume successfully.
Apr 21 02:30:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-61e5e10a-3cea-4489-a541-046f3fc21da4 tempest-VolumesListAdminTestJSON-143420319 None] Lock "cinder-bf737ea1-a64c-4067-b51b-82cf2ad0c3b2-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:39 devstack sudo[87771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:39 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:40 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.645s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:40 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Deleted volume successfully.
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-129873c4-2c46-4d40-96d2-33a2b149ffda tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-6c9b1698-6fd3-4e79-a667-d38229327c1b-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:40 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.560s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:40 devstack sudo[87777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6 1G
Apr 21 02:30:40 devstack sudo[87777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "cinder-5351aca9-7559-4d68-be8c-648b28e737ab-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-5351aca9-7559-4d68-be8c-648b28e737ab-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "cinder-quobyte-5351aca9-7559-4d68-be8c-648b28e737ab" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-quobyte-5351aca9-7559-4d68-be8c-648b28e737ab" acquired by "delete_volume" :: waited 0.024s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44a49f4-c440-4e1e-a687-dba4e53d2d8e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:40 devstack sudo[87779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab
Apr 21 02:30:40 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:40 devstack sudo[87777]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6 1G" returned: 0 in 0.576s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:41 devstack sudo[87784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6
Apr 21 02:30:41 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "cinder-64846717-72e8-4157-b010-cd4abca7db7e-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-64846717-72e8-4157-b010-cd4abca7db7e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "cinder-quobyte-64846717-72e8-4157-b010-cd4abca7db7e" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-quobyte-64846717-72e8-4157-b010-cd4abca7db7e" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[59465881-3c6c-4631-a6e4-2facb92c7915]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:41 devstack sudo[87786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e
Apr 21 02:30:41 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:41 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab" returned: 0 in 0.557s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:41 devstack sudo[87792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab
Apr 21 02:30:41 devstack sudo[87792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:41 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6" returned: 0 in 0.505s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:41 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6 is being set with open permissions: ugo+rw
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:41 devstack sudo[87797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6
Apr 21 02:30:41 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:41 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e" returned: 0 in 0.612s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:41 devstack sudo[87802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e
Apr 21 02:30:41 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:41 devstack sudo[87792]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5351aca9-7559-4d68-be8c-648b28e737ab" returned: 0 in 0.523s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-quobyte-5351aca9-7559-4d68-be8c-648b28e737ab" released by "delete_volume" :: held 1.113s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Created reservations ['c87d8e20-48cd-4325-9884-9bf313a005da', '3ff0cbe3-48f0-4ddf-a128-9fb16c7cd179', '744002bc-ecfd-4209-8980-da10812583b0', 'd7c99006-551d-4308-99c2-fbfa5f0b58b6'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:41 devstack sudo[87806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:41 devstack sudo[87806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:41 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6" returned: 0 in 0.490s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.212s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:42 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-2086eb23-6b5f-4c94-bda6-54193a5068be tempest-SnapshotsActionsTest-1727479891 None] Create snapshot completed successfully
Apr 21 02:30:42 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-64846717-72e8-4157-b010-cd4abca7db7e" returned: 0 in 0.526s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-quobyte-64846717-72e8-4157-b010-cd4abca7db7e" released by "delete_volume" :: held 1.162s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Created reservations ['3869b27f-9406-4ab1-a061-0feeafa274b4', '1eb12e37-52b7-4a11-ba9d-6a130cb79ada', '93492f84-7bca-4324-a572-5ffa22a8d4ca', '742f7774-e132-431b-9ab7-365110d33d14'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:42 devstack sudo[87809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:42 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:42 devstack sudo[87806]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.469s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:42 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Deleted volume successfully.
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ffb19311-fc8f-44f2-8f16-585959a1098c tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-5351aca9-7559-4d68-be8c-648b28e737ab-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:42 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.445s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:42 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Deleted volume successfully.
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b01adb3c-818e-4afe-8ae9-7c749a26d079 tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-64846717-72e8-4157-b010-cd4abca7db7e-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "cinder-a9948ba5-30fe-449e-8923-b47f0fc3f50f-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Flow 'volume_create_manager' (aee1166b-0076-4f36-9d04-82ec09a110e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062ef62e-1a57-4d2d-858a-909ed0362fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062ef62e-1a57-4d2d-858a-909ed0362fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1274592987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384d839d-9a43-41d8-aad4-0788340f32de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca84aea916548ea9eac690509cbbf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:43Z,use_quota=True,user_id='952b1a98572e49e59fd99882ffbeddb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f4ac3d-b039-487b-aad6-800174fb3c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37f4ac3d-b039-487b-aad6-800174fb3c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c24a74a-30f3-4868-8e86-96f1aac35536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c24a74a-30f3-4868-8e86-96f1aac35536) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '384d839d-9a43-41d8-aad4-0788340f32de', 'volume_name': 'volume-384d839d-9a43-41d8-aad4-0788340f32de', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c273c9-77ab-4dbc-80ee-e0f72e8597b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8c273c9-77ab-4dbc-80ee-e0f72e8597b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5ac94b-35d4-4a2c-87a7-9e6c41185165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:43 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Volume 384d839d-9a43-41d8-aad4-0788340f32de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-384d839d-9a43-41d8-aad4-0788340f32de', 'volume_size': 1}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1274592987',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=384d839d-9a43-41d8-aad4-0788340f32de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca84aea916548ea9eac690509cbbf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:43Z,use_quota=True,user_id='952b1a98572e49e59fd99882ffbeddb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Creating volume 384d839d-9a43-41d8-aad4-0788340f32de {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:43 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-a67bfc4b-6612-4db8-814b-aa3299d277c6-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-a9948ba5-30fe-449e-8923-b47f0fc3f50f-delete_volume" acquired by "delete_volume" :: waited 0.168s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:43 devstack sudo[87813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de 1073741824
Apr 21 02:30:43 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-a67bfc4b-6612-4db8-814b-aa3299d277c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Acquiring lock "cinder-quobyte-a67bfc4b-6612-4db8-814b-aa3299d277c6" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "cinder-quobyte-a9948ba5-30fe-449e-8923-b47f0fc3f50f" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-a67bfc4b-6612-4db8-814b-aa3299d277c6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Deleting offline snapshot a67bfc4b-6612-4db8-814b-aa3299d277c6 of volume 27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] snapshot_file for this snap is: volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c8d704-5252-4a38-b7d6-32f5395ab94f]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-quobyte-a9948ba5-30fe-449e-8923-b47f0fc3f50f" acquired by "delete_volume" :: waited 0.033s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ab3d3c-36c3-4adc-b641-97bfeae2b4aa]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:43 devstack sudo[87815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6
Apr 21 02:30:43 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "cinder-d8686718-b00d-4eff-aeec-d5a81c3a28a2-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-d8686718-b00d-4eff-aeec-d5a81c3a28a2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:43 devstack sudo[87816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f
Apr 21 02:30:43 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "cinder-quobyte-d8686718-b00d-4eff-aeec-d5a81c3a28a2" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-quobyte-d8686718-b00d-4eff-aeec-d5a81c3a28a2" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[986b4603-cfc9-4687-9ec3-0124b6020019]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:43 devstack sudo[87819]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2
Apr 21 02:30:43 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:43 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de 1073741824" returned: 0 in 0.495s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:43 devstack sudo[87825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de
Apr 21 02:30:43 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:43 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6" returned: 0 in 0.521s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a0c106-120d-42be-ae67-c756197b6a16]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:43 devstack sudo[87829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:43 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:43 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f" returned: 0 in 0.618s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:43 devstack sudo[87837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f
Apr 21 02:30:43 devstack sudo[87837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:43 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2" returned: 0 in 0.519s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:43 devstack sudo[87839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2
Apr 21 02:30:43 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:43 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de" returned: 0 in 0.433s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:43 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e5ac94b-35d4-4a2c-87a7-9e6c41185165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-384d839d-9a43-41d8-aad4-0788340f32de', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221cc06e-fdcf-46c0-b9a9-e0b641bdca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:44 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Volume volume-384d839d-9a43-41d8-aad4-0788340f32de (384d839d-9a43-41d8-aad4-0788340f32de): created successfully
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (221cc06e-fdcf-46c0-b9a9-e0b641bdca45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Flow 'volume_create_manager' (aee1166b-0076-4f36-9d04-82ec09a110e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:44 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c5ca06de-0b57-493d-9b85-3bb6a5f0a428 tempest-VolumesTransfersV357Test-1542763971 None] Created volume successfully.
Apr 21 02:30:44 devstack sudo[87837]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a9948ba5-30fe-449e-8923-b47f0fc3f50f" returned: 0 in 0.419s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-quobyte-a9948ba5-30fe-449e-8923-b47f0fc3f50f" released by "delete_volume" :: held 1.064s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:44 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.558s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Created reservations ['5e652f76-e1ba-427b-9e79-d74b4eab53b4', 'c035dc89-f5f9-498f-ae99-75f5cfe81ea8', '6280820e-a735-4a2b-aece-dec87cca9281', '3f4e4230-bc1f-403b-8b51-d27a8f52f5df'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:44 devstack sudo[87846]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6
Apr 21 02:30:44 devstack sudo[87846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:44 devstack sudo[87849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:44 devstack sudo[87849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:44 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d8686718-b00d-4eff-aeec-d5a81c3a28a2" returned: 0 in 0.476s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-quobyte-d8686718-b00d-4eff-aeec-d5a81c3a28a2" released by "delete_volume" :: held 1.018s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Created reservations ['9a580079-7070-4ac1-83c3-5ade64e0bbb0', '188e4418-64bd-4112-b8be-cb97f34b61c2', '8fe556c9-afd1-4127-97ca-1a70d7c64827', '32aee6bd-574a-4229-acff-271dc28c2a53'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:44 devstack sudo[87851]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:44 devstack sudo[87851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:44 devstack sudo[87846]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6" returned: 0 in 0.489s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:44 devstack sudo[87849]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.438s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:44 devstack sudo[87857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6
Apr 21 02:30:44 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:44 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Deleted volume successfully.
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-75059d08-b47d-4590-80cf-2c38c88bc3a7 tempest-VolumesListAdminTestJSON-419583830 None] Lock "cinder-a9948ba5-30fe-449e-8923-b47f0fc3f50f-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:44 devstack sudo[87851]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.415s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:44 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Deleted volume successfully.
Apr 21 02:30:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0312ece7-3876-4ca7-a9f7-8c7e541c2050 tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-d8686718-b00d-4eff-aeec-d5a81c3a28a2-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:45 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.a67bfc4b-6612-4db8-814b-aa3299d277c6" returned: 0 in 0.426s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-a67bfc4b-6612-4db8-814b-aa3299d277c6" released by "_delete_snapshot" :: held 2.051s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" released by "delete_snapshot" :: held 2.075s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:45 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Created reservations ['b6921ed1-96dc-4ce1-868c-861539507c7d', '5f268e3f-5d65-41fb-bfdc-007105e41681', '33221b7f-f6ce-438b-b734-3fcfe55b2ceb', '93f4c709-a64d-41cd-89f1-15817981e0cc'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:45 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Delete snapshot completed successfully.
Apr 21 02:30:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5aa3252-7a90-4774-a71e-e396e976870f tempest-SnapshotsActionsTest-1001518057 None] Lock "cinder-a67bfc4b-6612-4db8-814b-aa3299d277c6-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:45 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-2158f2d7-93ea-4641-9c71-9d4c9715b625 tempest-VolumesTransfersV357Test-654134239 None] Transfer volume completed successfully.
Apr 21 02:30:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "cinder-da3b9886-4ed2-4241-865f-89e2bc7a331e-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-da3b9886-4ed2-4241-865f-89e2bc7a331e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "cinder-quobyte-da3b9886-4ed2-4241-865f-89e2bc7a331e" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-quobyte-da3b9886-4ed2-4241-865f-89e2bc7a331e" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:45 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd25cd39-5d7f-4cd2-a39a-61065d3fd350]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:45 devstack sudo[87861]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e
Apr 21 02:30:45 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:46 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e" returned: 0 in 0.582s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:46 devstack sudo[87866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e
Apr 21 02:30:46 devstack sudo[87866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Acquiring lock "cinder-384d839d-9a43-41d8-aad4-0788340f32de-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "cinder-58e7804b-d04b-4183-9f70-e8c908460987-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Lock "cinder-58e7804b-d04b-4183-9f70-e8c908460987-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Lock "cinder-384d839d-9a43-41d8-aad4-0788340f32de-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "cinder-quobyte-58e7804b-d04b-4183-9f70-e8c908460987" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Lock "cinder-quobyte-58e7804b-d04b-4183-9f70-e8c908460987" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Deleting offline snapshot 58e7804b-d04b-4183-9f70-e8c908460987 of volume 27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] snapshot_file for this snap is: volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[f959df9c-68d7-458c-8dac-be2c327ae42b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Acquiring lock "cinder-quobyte-384d839d-9a43-41d8-aad4-0788340f32de" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Lock "cinder-quobyte-384d839d-9a43-41d8-aad4-0788340f32de" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c281c84c-eaf8-4d94-a7b5-fbe645243177]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:46 devstack sudo[87866]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-da3b9886-4ed2-4241-865f-89e2bc7a331e" returned: 0 in 0.519s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:46 devstack sudo[87868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:46 devstack sudo[87868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-quobyte-da3b9886-4ed2-4241-865f-89e2bc7a331e" released by "delete_volume" :: held 1.133s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Created reservations ['fc8d8d50-1ea3-40b5-b97a-68a74751c5c6', '69007bc3-1ead-4ea9-9795-b0a5765ff281', 'dd2d8c55-ef4e-4a39-838a-c19324e1a21a', 'e5ff0ae4-61b2-44a2-aa5d-d3006d4c8291'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:46 devstack sudo[87870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de
Apr 21 02:30:46 devstack sudo[87870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:46 devstack sudo[87873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:46 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:47 devstack sudo[87868]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.590s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27be326e-85b6-4b05-9948-0a456011012f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a0990c-c7c6-4af1-b7b8-3ea54f9fdc79]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:47 devstack sudo[87870]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de" returned: 0 in 0.583s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:47 devstack sudo[87883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de
Apr 21 02:30:47 devstack sudo[87883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:47 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.501s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:47 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Deleted volume successfully.
Apr 21 02:30:47 devstack sudo[87882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f
Apr 21 02:30:47 devstack sudo[87882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d3a38944-a394-4a09-a137-b2ca5dba599d tempest-VolumesListTestJSON-1881435685 None] Lock "cinder-da3b9886-4ed2-4241-865f-89e2bc7a331e-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:47 devstack sudo[87883]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-384d839d-9a43-41d8-aad4-0788340f32de" returned: 0 in 0.507s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:47 devstack sudo[87882]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Lock "cinder-quobyte-384d839d-9a43-41d8-aad4-0788340f32de" released by "delete_volume" :: held 1.129s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f" returned: 0 in 0.569s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:47 devstack sudo[87890]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:47 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Created reservations ['7a4d2610-3ac6-43da-a947-8440cb481c66', '77328203-751a-4bd9-9d9b-a388d1e88e55', 'be481bfd-f69e-4715-8748-5fd9893f6c17', '43648e6e-0c5e-4e26-ad84-6aba1695ee01'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:47 devstack sudo[87892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:47 devstack sudo[87892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:48 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.555s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:48 devstack sudo[87899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987
Apr 21 02:30:48 devstack sudo[87899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:48 devstack sudo[87892]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.604s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Deleted volume successfully.
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-00b0a7ec-13b7-4ccb-9664-10ca498f6ea1 tempest-VolumesTransfersV357Test-1953709759 None] Lock "cinder-384d839d-9a43-41d8-aad4-0788340f32de-delete_volume" released by "delete_volume" :: held 1.958s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:48 devstack sudo[87899]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f.58e7804b-d04b-4183-9f70-e8c908460987" returned: 0 in 0.507s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Lock "cinder-quobyte-58e7804b-d04b-4183-9f70-e8c908460987" released by "_delete_snapshot" :: held 2.309s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" released by "delete_snapshot" :: held 2.327s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Created reservations ['ee5cd467-4355-4c10-a848-e7cb5d5eec24', 'ec53ba1c-0033-4d09-b259-b7246abbcf62', '06883bc6-ff82-4160-ae1b-6eca79db464e', '6eb0648f-eb46-4e88-bce0-202e400d5ada'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Delete snapshot completed successfully.
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Flow 'volume_create_manager' (d17847a7-ddf3-4dd7-b742-e18631d755d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bcc835f-7e26-4d7d-818d-ae6dbfaf8acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f2830151-1d4d-41c0-ae2b-101868179c3e tempest-SnapshotsActionsTest-1727479891 None] Lock "cinder-58e7804b-d04b-4183-9f70-e8c908460987-delete_snapshot" released by "delete_snapshot" :: held 2.494s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bcc835f-7e26-4d7d-818d-ae6dbfaf8acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1200808227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f043670b-5597-4003-b26f-69cbf1480a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca84aea916548ea9eac690509cbbf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:49Z,use_quota=True,user_id='952b1a98572e49e59fd99882ffbeddb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cc5305-1ca8-4065-809f-96ee84c14806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cc5305-1ca8-4065-809f-96ee84c14806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4280e3fd-4445-4ea4-a0e8-4f5e20375da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4280e3fd-4445-4ea4-a0e8-4f5e20375da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f043670b-5597-4003-b26f-69cbf1480a8a', 'volume_name': 'volume-f043670b-5597-4003-b26f-69cbf1480a8a', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787ccbb2-eaac-4a2e-942e-83b5efbd2d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (787ccbb2-eaac-4a2e-942e-83b5efbd2d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8daea67-95d4-4b9d-bfc2-169656d4e795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:49 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Volume f043670b-5597-4003-b26f-69cbf1480a8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f043670b-5597-4003-b26f-69cbf1480a8a', 'volume_size': 1}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1200808227',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f043670b-5597-4003-b26f-69cbf1480a8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca84aea916548ea9eac690509cbbf8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:49Z,use_quota=True,user_id='952b1a98572e49e59fd99882ffbeddb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Creating volume f043670b-5597-4003-b26f-69cbf1480a8a {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:49 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:49 devstack sudo[87902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a 1073741824
Apr 21 02:30:49 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:49 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a 1073741824" returned: 0 in 0.538s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:49 devstack sudo[87907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a
Apr 21 02:30:49 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "cinder-27be326e-85b6-4b05-9948-0a456011012f-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Flow 'volume_create_manager' (f72f44b3-302d-4a87-9061-52bbecbd52f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e499e404-36fd-4b8a-957b-afe620396be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e499e404-36fd-4b8a-957b-afe620396be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-314689225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccf0f30-471f-4820-b320-7be7b8d43a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d327bbe4d54bca982439e038f251b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:50Z,use_quota=True,user_id='ad96ceedf31c42deb34b0f1c0eace246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec0cf02-7e7f-4817-9042-02aba192ef21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bec0cf02-7e7f-4817-9042-02aba192ef21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7325fa8a-c30c-43df-a249-eb74537a6158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7325fa8a-c30c-43df-a249-eb74537a6158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eccf0f30-471f-4820-b320-7be7b8d43a10', 'volume_name': 'volume-eccf0f30-471f-4820-b320-7be7b8d43a10', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5d6d48-8a46-4297-9670-5e508b54f28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff5d6d48-8a46-4297-9670-5e508b54f28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9deca70d-c7b6-42b3-a43a-53d01da8c5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:49 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Volume eccf0f30-471f-4820-b320-7be7b8d43a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eccf0f30-471f-4820-b320-7be7b8d43a10', 'volume_size': 1}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Lock "cinder-27be326e-85b6-4b05-9948-0a456011012f-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Flow 'volume_create_manager' (e600e72f-3844-4447-b509-60f55308e21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef4c9c2-7306-404b-b900-4cef7be5a761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ef4c9c2-7306-404b-b900-4cef7be5a761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1082000438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bed279f7f594cb0bf32f903c1e488ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:50Z,use_quota=True,user_id='76064b2242874277a96fd68c1e184682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9789c76-26b6-423e-9bab-059f35217819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9789c76-26b6-423e-9bab-059f35217819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4b52e8-f9f1-406c-89e7-15157bde5062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.image.glance [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Creating Keystone auth plugin from conf {{(pid=82686) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04a9e5a-9454-4d56-bfc0-c1d4ade5e6a6]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:50 devstack sudo[87910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f
Apr 21 02:30:50 devstack sudo[87910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:50 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a" returned: 0 in 0.474s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.253s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-314689225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eccf0f30-471f-4820-b320-7be7b8d43a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54d327bbe4d54bca982439e038f251b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:50Z,use_quota=True,user_id='ad96ceedf31c42deb34b0f1c0eace246',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Creating volume eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:50 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4b52e8-f9f1-406c-89e7-15157bde5062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8', 'volume_name': 'volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bc7d156c0>}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a665cfe-c3d4-4452-9e99-29d9d071ccb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:50 devstack sudo[87913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10 1073741824
Apr 21 02:30:50 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a665cfe-c3d4-4452-9e99-29d9d071ccb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94c845b-ed0f-44ec-bfe7-a537238af8a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:50 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Volume fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bc7d156c0>}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Trying to clone fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 from image a37d0fba-01d8-4cd2-930f-61c0be29507e at location (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]). {{(pid=82686) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8daea67-95d4-4b9d-bfc2-169656d4e795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f043670b-5597-4003-b26f-69cbf1480a8a', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39d592b-696c-400e-bb12-f1c937cfb480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:50 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Volume volume-f043670b-5597-4003-b26f-69cbf1480a8a (f043670b-5597-4003-b26f-69cbf1480a8a): created successfully
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39d592b-696c-400e-bb12-f1c937cfb480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Flow 'volume_create_manager' (d17847a7-ddf3-4dd7-b742-e18631d755d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:50 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-8f73545c-e694-4173-ad91-3eb6008fd8d9 tempest-VolumesTransfersV357Test-1542763971 None] Created volume successfully.
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 21 02:30:50 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Image download 20.69 MB at 20.69 MB/s
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf6af53-268b-4101-ac4c-f5202eda8e36]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:50 devstack sudo[87917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD
Apr 21 02:30:50 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:50 devstack sudo[87910]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f" returned: 0 in 0.521s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:50 devstack sudo[87922]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f
Apr 21 02:30:50 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:50 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10 1073741824" returned: 0 in 0.557s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:50 devstack sudo[87927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10
Apr 21 02:30:50 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:50 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD" returned: 0 in 0.493s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Temporary image a37d0fba-01d8-4cd2-930f-61c0be29507e is fetched for user 76064b2242874277a96fd68c1e184682. {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6dcfee-caf6-49df-aca3-2825be654abb]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:50 devstack sudo[87939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD
Apr 21 02:30:50 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:50 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-27be326e-85b6-4b05-9948-0a456011012f" returned: 0 in 0.464s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Lock "cinder-quobyte-27be326e-85b6-4b05-9948-0a456011012f" released by "delete_volume" :: held 1.036s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:50 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Created reservations ['a4ef7b1a-6e11-48c6-a56b-1e78ce46e489', '475c546e-139b-416c-8215-03503f2b6e4a', 'e6635c3c-3531-4fac-8a6a-b1918b235498', 'e6ec7a31-349d-4a0b-8025-b5e6470d59d0'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:51 devstack sudo[87941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:51 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:51 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10" returned: 0 in 0.471s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9deca70d-c7b6-42b3-a43a-53d01da8c5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eccf0f30-471f-4820-b320-7be7b8d43a10', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539f4e52-6818-46a8-a48e-23a5f1bb3a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:51 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Volume volume-eccf0f30-471f-4820-b320-7be7b8d43a10 (eccf0f30-471f-4820-b320-7be7b8d43a10): created successfully
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (539f4e52-6818-46a8-a48e-23a5f1bb3a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Flow 'volume_create_manager' (f72f44b3-302d-4a87-9061-52bbecbd52f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:51 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-31cce027-5de3-43b0-a1aa-41e3d92b7139 tempest-VolumesSnapshotListTestJSON-555341493 None] Created volume successfully.
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Acquiring lock "cinder-f043670b-5597-4003-b26f-69cbf1480a8a-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Lock "cinder-f043670b-5597-4003-b26f-69cbf1480a8a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Acquiring lock "cinder-quobyte-f043670b-5597-4003-b26f-69cbf1480a8a" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Lock "cinder-quobyte-f043670b-5597-4003-b26f-69cbf1480a8a" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[075dd3d6-bf5d-408b-88b6-fcf584061c53]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:51 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD" returned: 0 in 0.506s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1082000438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7bed279f7f594cb0bf32f903c1e488ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:50Z,use_quota=True,user_id='76064b2242874277a96fd68c1e184682',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Creating volume fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:51 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:51 devstack sudo[87949]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 1073741824
Apr 21 02:30:51 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:51 devstack sudo[87948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a
Apr 21 02:30:51 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:51 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.477s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:51 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Deleted volume successfully.
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a23c2a0-75fb-4a67-b95a-06492287856c tempest-SnapshotsActionsTest-1727479891 None] Lock "cinder-27be326e-85b6-4b05-9948-0a456011012f-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:51 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a" returned: 0 in 0.514s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:51 devstack sudo[87959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a
Apr 21 02:30:51 devstack sudo[87959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:51 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 1073741824" returned: 0 in 0.540s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:51 devstack sudo[87961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8
Apr 21 02:30:51 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:52 devstack sudo[87959]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f043670b-5597-4003-b26f-69cbf1480a8a" returned: 0 in 0.444s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Lock "cinder-quobyte-f043670b-5597-4003-b26f-69cbf1480a8a" released by "delete_volume" :: held 0.984s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Created reservations ['6ba83efc-1688-462f-afd2-b22efd55fadf', '8b837988-7afe-4f23-b033-cca7d9f42baa', 'dc39403d-edcd-496f-b145-005beca9fd6d', '4353c412-c174-4af1-9aa1-8f5e67b28a1b'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:52 devstack sudo[87965]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:30:52 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:52 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8" returned: 0 in 0.554s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.471s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] Creating offline snapshot ece80a84-d600-49d9-8e00-5baa79d8e3cf of volume eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[d518830d-c52e-4ac6-92f0-29b9667c6a07]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Attempting download of a37d0fba-01d8-4cd2-930f-61c0be29507e ((None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}])) to volume fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8. {{(pid=82686) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44dfc75-2cda-4b33-a7b1-44ed4dc17e67]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_coilp8nm {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:52 devstack sudo[87967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10
Apr 21 02:30:52 devstack sudo[87967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:52 devstack sudo[87968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_coilp8nm
Apr 21 02:30:52 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:53 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.620s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:30:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Deleted volume successfully.
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ed1f5c60-4b0a-4eef-9fc0-a38589c4be52 tempest-VolumesTransfersV357Test-1953709759 None] Lock "cinder-f043670b-5597-4003-b26f-69cbf1480a8a-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:30:53 devstack sudo[87967]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10" returned: 0 in 0.688s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:53 devstack sudo[87977]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf 1G
Apr 21 02:30:53 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:53 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_coilp8nm" returned: 0 in 0.693s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_coilp8nm {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:53 devstack sudo[87979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_coilp8nm
Apr 21 02:30:53 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:53 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf 1G" returned: 0 in 0.568s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccf0f30-471f-4820-b320-7be7b8d43a10 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:53 devstack sudo[87984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccf0f30-471f-4820-b320-7be7b8d43a10 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf
Apr 21 02:30:53 devstack sudo[87984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:53 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_coilp8nm" returned: 1 in 0.602s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_coilp8nm' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a796a93b-45dc-4970-a7ca-f6bc28c28fb6]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:53 devstack sudo[87988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD
Apr 21 02:30:53 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:54 devstack sudo[87984]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccf0f30-471f-4820-b320-7be7b8d43a10 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf" returned: 0 in 0.495s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:54 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf is being set with open permissions: ugo+rw
Apr 21 02:30:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:54 devstack sudo[87993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf
Apr 21 02:30:54 devstack sudo[87993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:54 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD" returned: 0 in 0.616s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:54 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] a37d0fba-01d8-4cd2-930f-61c0be29507e was qcow2, converting to raw {{(pid=82686) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 21 02:30:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:54 devstack sudo[87998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8
Apr 21 02:30:54 devstack sudo[87998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:54 devstack sudo[87993]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf" returned: 0 in 0.520s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:54 devstack sudo[88001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.info
Apr 21 02:30:54 devstack sudo[88001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:55 devstack sudo[88001]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.info" returned: 0 in 0.675s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:55 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.info is being set with open permissions: ugo+rw
Apr 21 02:30:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:55 devstack sudo[88010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.info
Apr 21 02:30:55 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:55 devstack sudo[87998]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8" returned: 0 in 1.104s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:55 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_8iy7f7q_devstack@QuobyteHD, size 112.00 MB, duration 1.11 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:30:55 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Converted 112.00 MB image at 101.30 MB/s
Apr 21 02:30:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:55 devstack sudo[88012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 1G
Apr 21 02:30:55 devstack sudo[88012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:56 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.info" returned: 0 in 0.543s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.553s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:56 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-589dceb8-341a-4e32-8833-32ec3ba7845c tempest-VolumesSnapshotListTestJSON-555341493 None] Create snapshot completed successfully
Apr 21 02:30:56 devstack sudo[88012]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 1G" returned: 0 in 0.524s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46fff8f-6ae2-4b96-883b-9f10a4c610b6]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Flow 'volume_create_manager' (e7447a02-b364-48be-a05f-f4c262e1874c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f76cb63-73bb-4308-ac96-4654722dfb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f76cb63-73bb-4308-ac96-4654722dfb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1195474129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81073981-af78-4f32-8d5f-343e60f07971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3ad1110123435f94c09338722775e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:56Z,use_quota=True,user_id='545b6dca51a44e44b5d634c065e939d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9efb649-e9b7-4998-b955-a5c39784dea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:56 devstack sudo[88018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8
Apr 21 02:30:56 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9efb649-e9b7-4998-b955-a5c39784dea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65885ee-2fb2-4fce-b11a-c140f891d68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65885ee-2fb2-4fce-b11a-c140f891d68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81073981-af78-4f32-8d5f-343e60f07971', 'volume_name': 'volume-81073981-af78-4f32-8d5f-343e60f07971', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1541e14-b508-4e2c-8c51-955cc9391cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1541e14-b508-4e2c-8c51-955cc9391cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fb891b-8813-4238-9c4c-904445361a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:56 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Volume 81073981-af78-4f32-8d5f-343e60f07971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81073981-af78-4f32-8d5f-343e60f07971', 'volume_size': 1}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1195474129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81073981-af78-4f32-8d5f-343e60f07971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3ad1110123435f94c09338722775e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:56Z,use_quota=True,user_id='545b6dca51a44e44b5d634c065e939d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Creating volume 81073981-af78-4f32-8d5f-343e60f07971 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:30:56 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:56 devstack sudo[88020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 1073741824
Apr 21 02:30:56 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:56 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8" returned: 0 in 0.556s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:56 devstack sudo[88027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8
Apr 21 02:30:56 devstack sudo[88027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:56 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 1073741824" returned: 0 in 0.543s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:56 devstack sudo[88029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971
Apr 21 02:30:56 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:57 devstack sudo[88027]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8" returned: 1 in 0.571s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Downloaded image a37d0fba-01d8-4cd2-930f-61c0be29507e ((None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}])) to volume fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 successfully. {{(pid=82686) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Temporary image a37d0fba-01d8-4cd2-930f-61c0be29507e for user 76064b2242874277a96fd68c1e184682 is deleted. {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Marking volume fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 as bootable. {{(pid=82686) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Copying metadata from image a37d0fba-01d8-4cd2-930f-61c0be29507e to fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8. {{(pid=82686) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Creating volume glance metadata for volume fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 backed by image a37d0fba-01d8-4cd2-930f-61c0be29507e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82686) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 21 02:30:57 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971" returned: 0 in 0.469s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f94c845b-ed0f-44ec-bfe7-a537238af8a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bc7d156c0>}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e85b0b-07fa-4549-9283-134b7fd2e56a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26fb891b-8813-4238-9c4c-904445361a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81073981-af78-4f32-8d5f-343e60f07971', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35871db-a99b-4e3a-aa65-d5e70f6401e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:57 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Volume volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 (fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8): created successfully
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e85b0b-07fa-4549-9283-134b7fd2e56a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Flow 'volume_create_manager' (e600e72f-3844-4447-b509-60f55308e21c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:57 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b7e29689-d62f-4b0a-b4bb-283219b5a9b1 tempest-VolumesImageMetadata-938890139 None] Created volume successfully.
Apr 21 02:30:57 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Volume volume-81073981-af78-4f32-8d5f-343e60f07971 (81073981-af78-4f32-8d5f-343e60f07971): created successfully
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e35871db-a99b-4e3a-aa65-d5e70f6401e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Flow 'volume_create_manager' (e7447a02-b364-48be-a05f-f4c262e1874c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] Creating offline snapshot d37a324c-3a03-4b78-9dc8-298329c520da of volume eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:30:57 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-13821fdc-8b16-4de5-b4f3-ddf5dd8dd87c tempest-VolumesCloneTest-1039516125 None] Created volume successfully.
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[81aca436-a327-4b3f-8acd-84636f9d3815]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:57 devstack sudo[88036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf
Apr 21 02:30:57 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:57 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf" returned: 0 in 0.499s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eccf0f30-471f-4820-b320-7be7b8d43a10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:30:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:58 devstack sudo[88073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da 1G
Apr 21 02:30:58 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Acquiring lock "cinder-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Lock "cinder-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:58 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da 1G" returned: 0 in 0.616s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:58 devstack sudo[88080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da
Apr 21 02:30:58 devstack sudo[88080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Acquiring lock "cinder-quobyte-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Lock "cinder-quobyte-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1be50df-5736-4658-979d-f755c4459e2f]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:30:58 devstack sudo[88082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8
Apr 21 02:30:58 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Flow 'volume_create_manager' (0c07108e-e464-4d7c-9c02-db82da488d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774ad468-9e7b-4db5-be52-566ee6607d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (774ad468-9e7b-4db5-be52-566ee6607d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-588956348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42d60033-40ab-4406-91d9-56f9330fb2b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab3ad1110123435f94c09338722775e0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:30:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=81073981-af78-4f32-8d5f-343e60f07971,status='creating',terminated_at=None,updated_at=2026-04-21T00:30:59Z,use_quota=True,user_id='545b6dca51a44e44b5d634c065e939d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f7b931-886f-4be6-8dbc-eaa86e7003f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3f7b931-886f-4be6-8dbc-eaa86e7003f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6dd328-2456-4b7b-9680-37f9527a65a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a6dd328-2456-4b7b-9680-37f9527a65a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '42d60033-40ab-4406-91d9-56f9330fb2b2', 'volume_name': 'volume-42d60033-40ab-4406-91d9-56f9330fb2b2', 'volume_size': 2, 'source_volid': '81073981-af78-4f32-8d5f-343e60f07971', 'source_volstatus': 'available'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6463f7f-144c-45d7-a816-59a7a6b538d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6463f7f-144c-45d7-a816-59a7a6b538d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2206f6c1-f049-4ad6-a0df-0a2383dd7324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:30:58 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Volume 42d60033-40ab-4406-91d9-56f9330fb2b2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-42d60033-40ab-4406-91d9-56f9330fb2b2', 'volume_size': 2, 'source_volid': '81073981-af78-4f32-8d5f-343e60f07971', 'source_volstatus': 'available'}
Apr 21 02:30:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:30:59 devstack sudo[88080]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da" returned: 0 in 0.554s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:59 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da is being set with open permissions: ugo+rw
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:59 devstack sudo[88089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da
Apr 21 02:30:59 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:59 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8" returned: 0 in 0.513s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:59 devstack sudo[88091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8
Apr 21 02:30:59 devstack sudo[88091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:59 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da" returned: 0 in 0.464s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.814s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:30:59 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Cloning volume 81073981-af78-4f32-8d5f-343e60f07971 to volume 42d60033-40ab-4406-91d9-56f9330fb2b2
Apr 21 02:30:59 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-a2009ac3-d12b-4758-adbc-6a140935e545 tempest-VolumesSnapshotListTestJSON-555341493 None] Create snapshot completed successfully
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Creating offline snapshot 2ecbcb58-9d5a-47ea-883a-c296f42ad35e of volume 81073981-af78-4f32-8d5f-343e60f07971 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff441541-dedf-4de2-85f3-448c4e669793]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:59 devstack sudo[88091]: pam_unix(sudo:session): session closed for user root
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8" returned: 1 in 0.537s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:30:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:30:59 devstack sudo[88098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8
Apr 21 02:30:59 devstack sudo[88098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:30:59 devstack sudo[88097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971
Apr 21 02:30:59 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:00 devstack sudo[88098]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8" returned: 0 in 0.489s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:00 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971" returned: 0 in 0.535s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Lock "cinder-quobyte-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8" released by "delete_volume" :: held 1.596s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:00 devstack sudo[88105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e 1G
Apr 21 02:31:00 devstack sudo[88105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Created reservations ['ae97886e-8bdc-4147-97c6-241e9e35f8fe', 'b9b0403f-a6ea-4293-b223-a2dc639942fe', '28fe5d06-97d7-401d-b10b-e5fb39953fb2', '3ae99159-1d47-4fdf-b8f8-4b92518b7ccb'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:00 devstack sudo[88107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:00 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:00 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.494s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:00 devstack sudo[88105]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e 1G" returned: 0 in 0.594s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81073981-af78-4f32-8d5f-343e60f07971 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:00 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Deleted volume successfully.
Apr 21 02:31:00 devstack sudo[88113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81073981-af78-4f32-8d5f-343e60f07971 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e
Apr 21 02:31:00 devstack sudo[88113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-248a3b54-4c82-492b-ad76-965b0973b434 tempest-VolumesImageMetadata-938890139 None] Lock "cinder-fa9eb83c-46ac-4f94-85aa-bf27f42ef4c8-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Flow 'volume_create_manager' (b3e00a9c-e679-41b5-a9fe-1a9846b3959f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb4bd8e-4ddd-4c4a-a161-dc7d14c824fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb4bd8e-4ddd-4c4a-a161-dc7d14c824fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-762071260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2d5795-7a05-4185-999e-98aa8acc7abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4057314cd3d843f9915b6ce1dcb7680c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:01Z,use_quota=True,user_id='a74fb3db19854c90bc574bbcd47ee93b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7a5e34-3c6a-4bde-a36b-b17f5f6c79e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7a5e34-3c6a-4bde-a36b-b17f5f6c79e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2e3949-323a-4c77-a55f-80ff7a74a3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b2e3949-323a-4c77-a55f-80ff7a74a3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b2d5795-7a05-4185-999e-98aa8acc7abc', 'volume_name': 'volume-1b2d5795-7a05-4185-999e-98aa8acc7abc', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32acaac0-c561-4881-b5ae-13cbe810fd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32acaac0-c561-4881-b5ae-13cbe810fd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84445b0b-0c41-4875-a797-7fc18349c021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:01 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Volume 1b2d5795-7a05-4185-999e-98aa8acc7abc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b2d5795-7a05-4185-999e-98aa8acc7abc', 'volume_size': 1}
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:01 devstack sudo[88113]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81073981-af78-4f32-8d5f-343e60f07971 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e" returned: 0 in 0.539s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:01 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e is being set with open permissions: ugo+rw
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:01 devstack sudo[88119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e
Apr 21 02:31:01 devstack sudo[88119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:01 devstack sudo[88119]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e" returned: 0 in 0.448s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:01 devstack sudo[88122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.info
Apr 21 02:31:01 devstack sudo[88122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:02 devstack sudo[88122]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.info" returned: 0 in 0.435s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:02 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.info is being set with open permissions: ugo+rw
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:02 devstack sudo[88125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.info
Apr 21 02:31:02 devstack sudo[88125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:02 devstack sudo[88125]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.info" returned: 0 in 0.438s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Acquiring lock "cinder-quobyte-42d60033-40ab-4406-91d9-56f9330fb2b2" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Lock "cinder-quobyte-42d60033-40ab-4406-91d9-56f9330fb2b2" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] snapshot: 2ecbcb58-9d5a-47ea-883a-c296f42ad35e, volume: 42d60033-40ab-4406-91d9-56f9330fb2b2,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[197d21cf-d73e-4c9b-8151-6502402064ec]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:02 devstack sudo[88128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e
Apr 21 02:31:02 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_service.periodic_task [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82686) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:02 devstack sudo[88130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:02 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:03 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e" returned: 0 in 0.546s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81073981-af78-4f32-8d5f-343e60f07971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:31:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:31:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:31:03 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50ab005-45c2-43f2-862c-38ed03aaca62]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:03 devstack sudo[88136]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971
Apr 21 02:31:03 devstack sudo[88136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:03 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.522s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:03 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:03 devstack sudo[88136]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971" returned: 0 in 0.518s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:03 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2 not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:31:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:03 devstack sudo[88141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2
Apr 21 02:31:03 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:05 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2" returned: 0 in 2.093s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:05 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1b5ba5-290e-4702-931a-08b824168c7e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:06 devstack sudo[88153]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971
Apr 21 02:31:06 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:06 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971" returned: 0 in 0.658s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:06 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:31:06 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Converted 1024.00 MB image at 488.90 MB/s
Apr 21 02:31:06 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2 is being set with open permissions: ugo+rw
Apr 21 02:31:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:06 devstack sudo[88158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2
Apr 21 02:31:06 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:07 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2" returned: 0 in 0.443s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Lock "cinder-quobyte-42d60033-40ab-4406-91d9-56f9330fb2b2" released by "_copy_volume_from_snapshot" :: held 4.314s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Acquiring lock "cinder-quobyte-2ecbcb58-9d5a-47ea-883a-c296f42ad35e" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Lock "cinder-quobyte-2ecbcb58-9d5a-47ea-883a-c296f42ad35e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Deleting offline snapshot 2ecbcb58-9d5a-47ea-883a-c296f42ad35e of volume 81073981-af78-4f32-8d5f-343e60f07971 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] snapshot_file for this snap is: volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3afd48-4dfc-4efa-92ef-6ffbc9b7555c]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:07 devstack sudo[88161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e
Apr 21 02:31:07 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:07 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e" returned: 0 in 0.561s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81073981-af78-4f32-8d5f-343e60f07971(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7ac53a-6937-453a-b738-761f3c3f51ee]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:07 devstack sudo[88166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971
Apr 21 02:31:07 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:08 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971" returned: 0 in 0.584s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:08 devstack sudo[88171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e
Apr 21 02:31:08 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:08 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e" returned: 0 in 0.514s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:08 devstack sudo[88176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e
Apr 21 02:31:08 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:09 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971.2ecbcb58-9d5a-47ea-883a-c296f42ad35e" returned: 0 in 0.441s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Lock "cinder-quobyte-2ecbcb58-9d5a-47ea-883a-c296f42ad35e" released by "_delete_snapshot" :: held 2.158s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.609s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.644s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2206f6c1-f049-4ad6-a0df-0a2383dd7324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42d60033-40ab-4406-91d9-56f9330fb2b2', 'volume_size': 2, 'source_volid': '81073981-af78-4f32-8d5f-343e60f07971', 'source_volstatus': 'available'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b6524e-989d-49d6-854c-f8fef895a4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:09 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Volume volume-42d60033-40ab-4406-91d9-56f9330fb2b2 (42d60033-40ab-4406-91d9-56f9330fb2b2): created successfully
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2b6524e-989d-49d6-854c-f8fef895a4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Flow 'volume_create_manager' (0c07108e-e464-4d7c-9c02-db82da488d94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] Creating offline snapshot d365aca6-d191-41b7-9fb9-a1a0854c74c5 of volume eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f56fa5-1995-467e-995b-0a6f80e35038]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:09 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6574e1ba-6750-4c99-8336-c775b9448673 tempest-VolumesCloneTest-1039516125 None] Created volume successfully.
Apr 21 02:31:09 devstack sudo[88179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da
Apr 21 02:31:09 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Acquiring lock "cinder-42d60033-40ab-4406-91d9-56f9330fb2b2-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Lock "cinder-42d60033-40ab-4406-91d9-56f9330fb2b2-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Acquiring lock "cinder-quobyte-42d60033-40ab-4406-91d9-56f9330fb2b2" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Lock "cinder-quobyte-42d60033-40ab-4406-91d9-56f9330fb2b2" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fde647a-e4b7-46d4-b258-06e98e8ee878]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:09 devstack sudo[88181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2
Apr 21 02:31:09 devstack sudo[88181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Flow 'volume_create_manager' (d0b627c2-0d1e-434b-a57b-3f592f4ddce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee1193f-2195-4baa-9ba8-04b815a14caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee1193f-2195-4baa-9ba8-04b815a14caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1622441956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44911e6a-2d25-431a-a29e-8d1f75bd5bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cfb4890271e4eaeacbc3bf51b30a3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:10Z,use_quota=True,user_id='fab5806e74c44a7cadfb105e348a0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0189449-d60e-43b9-b2e8-9bbbc326a7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0189449-d60e-43b9-b2e8-9bbbc326a7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7250cc-595e-4bbc-86ec-f116996bd7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7250cc-595e-4bbc-86ec-f116996bd7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44911e6a-2d25-431a-a29e-8d1f75bd5bc3', 'volume_name': 'volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c8a46d-d2f7-4d4b-8491-7777b8a39f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80c8a46d-d2f7-4d4b-8491-7777b8a39f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702f2824-8148-451a-b6dc-c147f13a39f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:09 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Volume 44911e6a-2d25-431a-a29e-8d1f75bd5bc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3', 'volume_size': 1}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:09 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da" returned: 0 in 0.577s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eccf0f30-471f-4820-b320-7be7b8d43a10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:31:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:09 devstack sudo[88186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5 1G
Apr 21 02:31:09 devstack sudo[88186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:10 devstack sudo[88181]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2" returned: 0 in 0.512s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:10 devstack sudo[88191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2
Apr 21 02:31:10 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:10 devstack sudo[88186]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5 1G" returned: 0 in 0.537s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:10 devstack sudo[88196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5
Apr 21 02:31:10 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:10 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-42d60033-40ab-4406-91d9-56f9330fb2b2" returned: 0 in 0.499s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Lock "cinder-quobyte-42d60033-40ab-4406-91d9-56f9330fb2b2" released by "delete_volume" :: held 1.034s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Created reservations ['d0e36c61-cd8d-4a40-b975-4950e82be705', '048c9761-c12b-47a4-9a7a-89f03d87d50c', 'f3e3aa7e-7575-44c2-aca3-53ac05ea3630', 'bbb0605e-3b4c-403d-a69a-6bbbdaa8dc52'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:10 devstack sudo[88199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:10 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:10 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5" returned: 0 in 0.470s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:10 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5 is being set with open permissions: ugo+rw
Apr 21 02:31:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:10 devstack sudo[88204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5
Apr 21 02:31:10 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:11 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.423s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:11 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Deleted volume successfully.
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ad19c0f8-2d74-4ffe-92ee-9c73efd1491e tempest-VolumesCloneTest-1039516125 None] Lock "cinder-42d60033-40ab-4406-91d9-56f9330fb2b2-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:11 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5" returned: 0 in 0.407s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.092s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.323s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-762071260',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b2d5795-7a05-4185-999e-98aa8acc7abc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4057314cd3d843f9915b6ce1dcb7680c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:01Z,use_quota=True,user_id='a74fb3db19854c90bc574bbcd47ee93b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Creating volume 1b2d5795-7a05-4185-999e-98aa8acc7abc {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:11 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:11 devstack sudo[88209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc 1073741824
Apr 21 02:31:11 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:11 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-518df05b-4be0-441b-bb72-d7313d1a5730 tempest-VolumesSnapshotListTestJSON-555341493 None] Create snapshot completed successfully
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Acquiring lock "cinder-81073981-af78-4f32-8d5f-343e60f07971-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Lock "cinder-81073981-af78-4f32-8d5f-343e60f07971-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Acquiring lock "cinder-quobyte-81073981-af78-4f32-8d5f-343e60f07971" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Lock "cinder-quobyte-81073981-af78-4f32-8d5f-343e60f07971" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d8d5e5-bf73-4fb6-84c7-a4b3c9533aa1]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:11 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc 1073741824" returned: 0 in 0.532s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:11 devstack sudo[88214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971
Apr 21 02:31:11 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:11 devstack sudo[88215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc
Apr 21 02:31:11 devstack sudo[88215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:12 devstack sudo[88215]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc" returned: 0 in 0.438s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1622441956',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44911e6a-2d25-431a-a29e-8d1f75bd5bc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cfb4890271e4eaeacbc3bf51b30a3fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:10Z,use_quota=True,user_id='fab5806e74c44a7cadfb105e348a0833',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Creating volume 44911e6a-2d25-431a-a29e-8d1f75bd5bc3 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:12 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:12 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84445b0b-0c41-4875-a797-7fc18349c021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b2d5795-7a05-4185-999e-98aa8acc7abc', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600da3dd-cdf0-4f4c-89ba-1b8cff0eed2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:12 devstack sudo[88224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 1073741824
Apr 21 02:31:12 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971" returned: 0 in 0.547s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:12 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Volume volume-1b2d5795-7a05-4185-999e-98aa8acc7abc (1b2d5795-7a05-4185-999e-98aa8acc7abc): created successfully
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (600da3dd-cdf0-4f4c-89ba-1b8cff0eed2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Flow 'volume_create_manager' (b3e00a9c-e679-41b5-a9fe-1a9846b3959f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:12 devstack sudo[88226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971
Apr 21 02:31:12 devstack sudo[88226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:12 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-5baa8377-cd96-4bcb-9ef4-877b2a0e68a3 tempest-SnapshotMetadataTestJSON-1027994070 None] Created volume successfully.
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "cinder-d365aca6-d191-41b7-9fb9-a1a0854c74c5-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-d365aca6-d191-41b7-9fb9-a1a0854c74c5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "cinder-quobyte-d365aca6-d191-41b7-9fb9-a1a0854c74c5" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-d365aca6-d191-41b7-9fb9-a1a0854c74c5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Deleting offline snapshot d365aca6-d191-41b7-9fb9-a1a0854c74c5 of volume eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] snapshot_file for this snap is: volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a7de29-59bb-4413-92d3-c82cc4544632]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:12 devstack sudo[88228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5
Apr 21 02:31:12 devstack sudo[88228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:12 devstack sudo[88226]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-81073981-af78-4f32-8d5f-343e60f07971" returned: 0 in 0.500s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Lock "cinder-quobyte-81073981-af78-4f32-8d5f-343e60f07971" released by "delete_volume" :: held 1.075s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:12 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 1073741824" returned: 0 in 0.550s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:12 devstack sudo[88234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3
Apr 21 02:31:12 devstack sudo[88234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:12 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Created reservations ['3c44ff93-9cba-4714-94bf-0dd4c4c7b969', '1d1b41db-e639-4701-b68f-56397fec68f6', 'a9d5204d-bab7-46ac-85e1-b6ed84fde848', '9f3a28ca-1a69-4d47-bfca-0b036c2dd274'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:13 devstack sudo[88236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:13 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:13 devstack sudo[88228]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5" returned: 0 in 0.559s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eccf0f30-471f-4820-b320-7be7b8d43a10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ff0e6f-514e-403a-ae95-8a86ad5bf5b6]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:13 devstack sudo[88241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da
Apr 21 02:31:13 devstack sudo[88241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:13 devstack sudo[88234]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" returned: 0 in 0.427s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.545s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (702f2824-8148-451a-b6dc-c147f13a39f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8883bfdd-5ee9-4667-a652-abff4d6759ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] Creating offline snapshot 8d3da0e3-a00d-4fc0-883e-dcd541525cea of volume 1b2d5795-7a05-4185-999e-98aa8acc7abc {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[e316dcd7-840b-46f7-9cc3-51cae5e2b315]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:13 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Volume volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 (44911e6a-2d25-431a-a29e-8d1f75bd5bc3): created successfully
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8883bfdd-5ee9-4667-a652-abff4d6759ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Flow 'volume_create_manager' (d0b627c2-0d1e-434b-a57b-3f592f4ddce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:13 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.426s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:13 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b550fbac-0934-427d-a92e-b199b4caba51 tempest-VolumesActionsTest-371563670 None] Created volume successfully.
Apr 21 02:31:13 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Deleted volume successfully.
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c540cfcb-e3cf-4881-b0c4-7c1007567796 tempest-VolumesCloneTest-1039516125 None] Lock "cinder-81073981-af78-4f32-8d5f-343e60f07971-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:13 devstack sudo[88245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc
Apr 21 02:31:13 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:13 devstack sudo[88241]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da" returned: 0 in 0.499s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eccf0f30-471f-4820-b320-7be7b8d43a10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:13 devstack sudo[88250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5
Apr 21 02:31:13 devstack sudo[88250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:13 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc" returned: 0 in 0.472s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:13 devstack sudo[88255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea 1G
Apr 21 02:31:13 devstack sudo[88255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:14 devstack sudo[88250]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5" returned: 0 in 0.591s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:14 devstack sudo[88263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5
Apr 21 02:31:14 devstack sudo[88263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:14 devstack sudo[88255]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea 1G" returned: 0 in 0.614s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b2d5795-7a05-4185-999e-98aa8acc7abc -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:14 devstack sudo[88265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b2d5795-7a05-4185-999e-98aa8acc7abc -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea
Apr 21 02:31:14 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:14 devstack sudo[88263]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d365aca6-d191-41b7-9fb9-a1a0854c74c5" returned: 0 in 0.604s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-d365aca6-d191-41b7-9fb9-a1a0854c74c5" released by "_delete_snapshot" :: held 2.311s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" released by "delete_snapshot" :: held 2.325s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Created reservations ['b8900a07-317e-4d26-9892-bb7755e573ef', 'e16a16c6-fe2c-475b-a561-e36003fd0b84', '418de7f7-d205-46f8-9200-9676ea6e0dcd', '02b1e075-b4c6-4f51-aed2-95307e405fc1'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:15 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Delete snapshot completed successfully.
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c8c130-1cdf-4b5e-82fb-0947e81567a8 tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-d365aca6-d191-41b7-9fb9-a1a0854c74c5-delete_snapshot" released by "delete_snapshot" :: held 2.415s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:15 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b2d5795-7a05-4185-999e-98aa8acc7abc -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea" returned: 0 in 0.582s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:15 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea is being set with open permissions: ugo+rw
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:15 devstack sudo[88274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea
Apr 21 02:31:15 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:15 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea" returned: 0 in 0.502s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:15 devstack sudo[88278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.info
Apr 21 02:31:15 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "cinder-d37a324c-3a03-4b78-9dc8-298329c520da-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-d37a324c-3a03-4b78-9dc8-298329c520da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "cinder-quobyte-d37a324c-3a03-4b78-9dc8-298329c520da" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-d37a324c-3a03-4b78-9dc8-298329c520da" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Deleting offline snapshot d37a324c-3a03-4b78-9dc8-298329c520da of volume eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] snapshot_file for this snap is: volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bae209-9518-46cd-ac2f-a41c6f297f05]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Flow 'volume_create_manager' (0bc9a1e1-0562-4945-85dd-f2aabf68a207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe28dd2-6d6c-4234-9fbf-fbec48ca3d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe28dd2-6d6c-4234-9fbf-fbec48ca3d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-460112509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a42b82f-b262-48fd-989f-66987d79c609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3cedb144d94a6ebc030364901b9709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:16Z,use_quota=True,user_id='fb11d1c667864719858b050d7f01fa3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:15 devstack sudo[88280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da
Apr 21 02:31:15 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68e5d30-7d76-499f-a0db-0b535bcb5a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b68e5d30-7d76-499f-a0db-0b535bcb5a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa65b74-8c7a-4c50-b5cd-1dba4714f41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aa65b74-8c7a-4c50-b5cd-1dba4714f41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a42b82f-b262-48fd-989f-66987d79c609', 'volume_name': 'volume-9a42b82f-b262-48fd-989f-66987d79c609', 'volume_size': 2}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1817f308-b0ff-45ba-a410-378369163786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1817f308-b0ff-45ba-a410-378369163786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9d3d8b-b5ad-474f-860d-9e46839723b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:15 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Volume 9a42b82f-b262-48fd-989f-66987d79c609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a42b82f-b262-48fd-989f-66987d79c609', 'volume_size': 2}
Apr 21 02:31:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:16 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.info" returned: 0 in 0.492s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:16 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.info is being set with open permissions: ugo+rw
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:16 devstack sudo[88283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.info
Apr 21 02:31:16 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:16 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da" returned: 0 in 0.541s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eccf0f30-471f-4820-b320-7be7b8d43a10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b4ce6b-e6fe-4495-af36-401f6047ba45]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:16 devstack sudo[88288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf
Apr 21 02:31:16 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:16 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.info" returned: 0 in 0.447s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.176s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.603s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-460112509',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a42b82f-b262-48fd-989f-66987d79c609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3cedb144d94a6ebc030364901b9709',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:16Z,use_quota=True,user_id='fb11d1c667864719858b050d7f01fa3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Creating volume 9a42b82f-b262-48fd-989f-66987d79c609 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:16 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609 2147483648 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:16 devstack sudo[88291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609 2147483648
Apr 21 02:31:16 devstack sudo[88291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:16 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-bc182c57-6ff5-4e09-9e48-3ab1c67c72fa tempest-SnapshotMetadataTestJSON-1027994070 None] Create snapshot completed successfully
Apr 21 02:31:16 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf" returned: 0 in 0.490s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eccf0f30-471f-4820-b320-7be7b8d43a10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:31:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:16 devstack sudo[88298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da
Apr 21 02:31:16 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:17 devstack sudo[88291]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609 2147483648" returned: 0 in 0.524s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:17 devstack sudo[88301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609
Apr 21 02:31:17 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:17 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da" returned: 0 in 0.543s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:17 devstack sudo[88306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da
Apr 21 02:31:17 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:17 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Acquiring lock "cinder-8d3da0e3-a00d-4fc0-883e-dcd541525cea-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609" returned: 0 in 0.446s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "cinder-8d3da0e3-a00d-4fc0-883e-dcd541525cea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Acquiring lock "cinder-quobyte-1b2d5795-7a05-4185-999e-98aa8acc7abc" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9d3d8b-b5ad-474f-860d-9e46839723b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a42b82f-b262-48fd-989f-66987d79c609', 'volume_size': 2}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d0b0c7-8b90-4e05-a466-43e8651df594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "cinder-quobyte-1b2d5795-7a05-4185-999e-98aa8acc7abc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Acquiring lock "cinder-quobyte-8d3da0e3-a00d-4fc0-883e-dcd541525cea" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:17 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Volume volume-9a42b82f-b262-48fd-989f-66987d79c609 (9a42b82f-b262-48fd-989f-66987d79c609): created successfully
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d0b0c7-8b90-4e05-a466-43e8651df594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Flow 'volume_create_manager' (0bc9a1e1-0562-4945-85dd-f2aabf68a207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "cinder-quobyte-8d3da0e3-a00d-4fc0-883e-dcd541525cea" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Deleting offline snapshot 8d3da0e3-a00d-4fc0-883e-dcd541525cea of volume 1b2d5795-7a05-4185-999e-98aa8acc7abc {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] snapshot_file for this snap is: volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:31:17 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c275df58-d7e8-400b-80d4-bbde7b11814c tempest-VolumesCloneNegativeTest-223138635 None] Created volume successfully.
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e6f5dd-af49-4ed3-95a7-6da8bb20b6a6]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:17 devstack sudo[88309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea
Apr 21 02:31:17 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:17 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.d37a324c-3a03-4b78-9dc8-298329c520da" returned: 0 in 0.479s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-d37a324c-3a03-4b78-9dc8-298329c520da" released by "_delete_snapshot" :: held 2.108s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" released by "delete_snapshot" :: held 2.125s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Created reservations ['cb4a103e-331c-4f62-8993-34f9050770a9', 'd9a99d91-a9cd-402b-9687-d516f8467ddc', '3f60995f-71cf-417a-b7d1-7a02db02b703', 'a460e06c-6c88-4f3c-b9ab-7965a413ecd1'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:18 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Delete snapshot completed successfully.
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-99acde6a-5ffe-4f64-b449-e9317c47ddeb tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-d37a324c-3a03-4b78-9dc8-298329c520da-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Acquiring lock "cinder-9a42b82f-b262-48fd-989f-66987d79c609-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Lock "cinder-9a42b82f-b262-48fd-989f-66987d79c609-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Acquiring lock "cinder-quobyte-9a42b82f-b262-48fd-989f-66987d79c609" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Lock "cinder-quobyte-9a42b82f-b262-48fd-989f-66987d79c609" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9056c8-724f-457d-824f-1697343b3af3]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:18 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea" returned: 0 in 0.526s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b2d5795-7a05-4185-999e-98aa8acc7abc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:31:18 devstack sudo[88315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609
Apr 21 02:31:18 devstack sudo[88315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca67cebd-6ecf-49f2-90ac-c043b2c344a5]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:18 devstack sudo[88317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc
Apr 21 02:31:18 devstack sudo[88317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:18 devstack sudo[88315]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609" returned: 0 in 0.483s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:18 devstack sudo[88324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609
Apr 21 02:31:18 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:18 devstack sudo[88317]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc" returned: 0 in 0.491s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:18 devstack sudo[88327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea
Apr 21 02:31:18 devstack sudo[88327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "cinder-ece80a84-d600-49d9-8e00-5baa79d8e3cf-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-ece80a84-d600-49d9-8e00-5baa79d8e3cf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "cinder-quobyte-ece80a84-d600-49d9-8e00-5baa79d8e3cf" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-ece80a84-d600-49d9-8e00-5baa79d8e3cf" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Deleting offline snapshot ece80a84-d600-49d9-8e00-5baa79d8e3cf of volume eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:31:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] snapshot_file for this snap is: volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8548a9db-3670-4a56-adec-e44ceec8e117]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:19 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9a42b82f-b262-48fd-989f-66987d79c609" returned: 0 in 0.448s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Lock "cinder-quobyte-9a42b82f-b262-48fd-989f-66987d79c609" released by "delete_volume" :: held 0.962s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:19 devstack sudo[88330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf
Apr 21 02:31:19 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Created reservations ['1381fe7d-256b-44ce-9d6d-aa52fd785b12', 'dab508d7-81bf-44e4-8942-214c9c25b31c', '5a952e96-4317-4664-a11b-1572e5ed9192', '23a3896d-1204-4af9-84cc-01264ed246c3'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:19 devstack sudo[88327]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea" returned: 0 in 0.483s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:19 devstack sudo[88335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:19 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:19 devstack sudo[88336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea
Apr 21 02:31:19 devstack sudo[88336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:19 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.545s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:19 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Deleted volume successfully.
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-32a280fb-fbd6-4c1d-a7fe-9da184d9579d tempest-VolumesCloneNegativeTest-223138635 None] Lock "cinder-9a42b82f-b262-48fd-989f-66987d79c609-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:19 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf" returned: 0 in 0.789s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eccf0f30-471f-4820-b320-7be7b8d43a10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[db83b797-68a6-4666-b685-25aed96c7f12]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:19 devstack sudo[88346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10
Apr 21 02:31:19 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:19 devstack sudo[88336]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc.8d3da0e3-a00d-4fc0-883e-dcd541525cea" returned: 0 in 0.713s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "cinder-quobyte-8d3da0e3-a00d-4fc0-883e-dcd541525cea" released by "_delete_snapshot" :: held 2.280s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "cinder-quobyte-1b2d5795-7a05-4185-999e-98aa8acc7abc" released by "delete_snapshot" :: held 2.305s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:19 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Created reservations ['cadcbca2-c57f-4fd3-9a8f-90c840db6a86', '17589558-6eff-4d18-ab5c-be7965742754', '4e52d239-7e1c-486c-99bf-f23801265eb0', 'bf982d4d-80c6-40af-9f23-60a486a1dd2f'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:20 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Delete snapshot completed successfully.
Apr 21 02:31:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e64f568d-b422-4955-b081-b6751c9b6209 tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "cinder-8d3da0e3-a00d-4fc0-883e-dcd541525cea-delete_snapshot" released by "delete_snapshot" :: held 2.431s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:20 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10" returned: 0 in 0.705s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:20 devstack sudo[88351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf
Apr 21 02:31:20 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Acquiring lock "cinder-1b2d5795-7a05-4185-999e-98aa8acc7abc-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "cinder-1b2d5795-7a05-4185-999e-98aa8acc7abc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Acquiring lock "cinder-quobyte-1b2d5795-7a05-4185-999e-98aa8acc7abc" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "cinder-quobyte-1b2d5795-7a05-4185-999e-98aa8acc7abc" acquired by "delete_volume" :: waited 0.015s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:20 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da329d0-f9c2-4ee8-9b2f-7bd154749f71]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:21 devstack sudo[88353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc
Apr 21 02:31:21 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:21 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf" returned: 0 in 0.631s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:21 devstack sudo[88358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf
Apr 21 02:31:21 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:21 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10.ece80a84-d600-49d9-8e00-5baa79d8e3cf" returned: 0 in 0.529s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-ece80a84-d600-49d9-8e00-5baa79d8e3cf" released by "_delete_snapshot" :: held 2.725s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" released by "delete_snapshot" :: held 2.738s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:21 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Created reservations ['7c04c3b8-0b3d-4edd-9005-898582a33c83', 'bffa1754-01ef-410a-a440-4602a7203b76', '3598c0a4-ded0-449c-864d-e4b44461f906', '39558304-a264-4ff5-84fc-b6904e3fe9a2'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:21 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Delete snapshot completed successfully.
Apr 21 02:31:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-35b37752-550a-4353-9b7a-aa8c10f50d7d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-ece80a84-d600-49d9-8e00-5baa79d8e3cf-delete_snapshot" released by "delete_snapshot" :: held 2.819s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:21 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc" returned: 0 in 0.872s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:21 devstack sudo[88379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc
Apr 21 02:31:21 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "cinder-eccf0f30-471f-4820-b320-7be7b8d43a10-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-eccf0f30-471f-4820-b320-7be7b8d43a10-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:22 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1b2d5795-7a05-4185-999e-98aa8acc7abc" returned: 0 in 0.459s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "cinder-quobyte-1b2d5795-7a05-4185-999e-98aa8acc7abc" released by "delete_volume" :: held 1.360s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" acquired by "delete_volume" :: waited 0.023s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[11635a44-3fbc-49cd-a150-c4b97f889f4c]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Created reservations ['9b0eb817-af34-40ed-a695-6380cad11f1d', '6f20d85c-7025-47c5-b894-8e58e94a4e66', '2ce2cfee-4b70-41f1-b30e-ca479b6257af', '132b15b7-dfae-49fc-87e9-b593901cfe0e'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:22 devstack sudo[88384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:22 devstack sudo[88384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:22 devstack sudo[88386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:22 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:22 devstack sudo[88384]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10" returned: 0 in 0.481s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:22 devstack sudo[88392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10
Apr 21 02:31:22 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:22 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.454s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:22 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Deleted volume successfully.
Apr 21 02:31:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ce709816-553f-4225-b444-382c32c6adaa tempest-SnapshotMetadataTestJSON-1027994070 None] Lock "cinder-1b2d5795-7a05-4185-999e-98aa8acc7abc-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:23 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-eccf0f30-471f-4820-b320-7be7b8d43a10" returned: 0 in 0.489s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-quobyte-eccf0f30-471f-4820-b320-7be7b8d43a10" released by "delete_volume" :: held 1.015s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Created reservations ['884ee5d6-9e78-4dbe-8416-723b64b1eef1', '751b1db0-5dfc-4829-b3ea-6a6ed19300f7', '9f74cfd8-4396-4716-a9d5-157cf578fd0b', '73f1281a-691e-4bde-ab35-5e28ba0fb34b'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:23 devstack sudo[88395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:23 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:23 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.464s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:23 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Deleted volume successfully.
Apr 21 02:31:23 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-282b75df-0550-41c4-8f52-756d7bd9312d tempest-VolumesSnapshotListTestJSON-555341493 None] Lock "cinder-eccf0f30-471f-4820-b320-7be7b8d43a10-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Flow 'volume_create_manager' (dd20ea79-f148-454f-803b-9a0531bc0849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c692763-3cf1-4732-b594-d1a80f17aacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c692763-3cf1-4732-b594-d1a80f17aacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1907065241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba0d74a-6e74-414e-8624-1ea2e2d574a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5022e5efad6f4512b16c1214e93736ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:25Z,use_quota=True,user_id='d51fa33ccd3f4f8f9b8ac655e56edb9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f714da-d5b6-4b54-b4f9-f5c863f33ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6f714da-d5b6-4b54-b4f9-f5c863f33ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a930af1-97ec-4b9e-85ce-56d68446246c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a930af1-97ec-4b9e-85ce-56d68446246c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ba0d74a-6e74-414e-8624-1ea2e2d574a6', 'volume_name': 'volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858ee837-96ff-4bfb-82e0-7f963387e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (858ee837-96ff-4bfb-82e0-7f963387e807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984579e0-7eac-4eb0-8f17-e8dc371e5a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:25 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Volume 8ba0d74a-6e74-414e-8624-1ea2e2d574a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6', 'volume_size': 1}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1907065241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ba0d74a-6e74-414e-8624-1ea2e2d574a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5022e5efad6f4512b16c1214e93736ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:25Z,use_quota=True,user_id='d51fa33ccd3f4f8f9b8ac655e56edb9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Creating volume 8ba0d74a-6e74-414e-8624-1ea2e2d574a6 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:25 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:25 devstack sudo[88398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6 1073741824
Apr 21 02:31:25 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:25 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6 1073741824" returned: 0 in 0.654s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:25 devstack sudo[88406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6
Apr 21 02:31:25 devstack sudo[88406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:26 devstack sudo[88406]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (01636f71-e757-43c6-a3d6-5e68c36af79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d47177-e2fb-41dc-b170-c4e24f10e095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6" returned: 0 in 0.520s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984579e0-7eac-4eb0-8f17-e8dc371e5a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b53003d-d18f-4157-9104-b43c7533e110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d47177-e2fb-41dc-b170-c4e24f10e095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595617503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83487fd-b9be-4d72-951a-8ce850a23c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:26Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8898aafa-be39-4676-ac34-bcd475b69c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8898aafa-be39-4676-ac34-bcd475b69c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8343d0b-ec25-4150-bbd1-4415aa3df882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8343d0b-ec25-4150-bbd1-4415aa3df882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83487fd-b9be-4d72-951a-8ce850a23c23', 'volume_name': 'volume-f83487fd-b9be-4d72-951a-8ce850a23c23', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627c4ae3-9154-4ef8-8546-cfcbf78858ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627c4ae3-9154-4ef8-8546-cfcbf78858ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed67258-849d-41c6-8ae5-195b331e7cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:26 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume f83487fd-b9be-4d72-951a-8ce850a23c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83487fd-b9be-4d72-951a-8ce850a23c23', 'volume_size': 1}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1595617503',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83487fd-b9be-4d72-951a-8ce850a23c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:26Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Creating volume f83487fd-b9be-4d72-951a-8ce850a23c23 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:26 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:26 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Volume volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6 (8ba0d74a-6e74-414e-8624-1ea2e2d574a6): created successfully
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b53003d-d18f-4157-9104-b43c7533e110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Flow 'volume_create_manager' (dd20ea79-f148-454f-803b-9a0531bc0849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:26 devstack sudo[88409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23 1073741824
Apr 21 02:31:26 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:26 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-658c49dd-913e-4244-a7d1-c1df671de83d tempest-VolumesMetadataTest-872181271 None] Created volume successfully.
Apr 21 02:31:27 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23 1073741824" returned: 0 in 0.660s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:27 devstack sudo[88441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23
Apr 21 02:31:27 devstack sudo[88441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:27 devstack sudo[88441]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23" returned: 0 in 0.566s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed67258-849d-41c6-8ae5-195b331e7cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83487fd-b9be-4d72-951a-8ce850a23c23', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc20168-e4f3-4f04-a17c-edba1b26e485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:27 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume volume-f83487fd-b9be-4d72-951a-8ce850a23c23 (f83487fd-b9be-4d72-951a-8ce850a23c23): created successfully
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc20168-e4f3-4f04-a17c-edba1b26e485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (01636f71-e757-43c6-a3d6-5e68c36af79f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:27 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-54b3aa95-5ed9-4597-bf5d-38ea66725e6c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created volume successfully.
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Acquiring lock "cinder-8ba0d74a-6e74-414e-8624-1ea2e2d574a6-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Lock "cinder-8ba0d74a-6e74-414e-8624-1ea2e2d574a6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Acquiring lock "cinder-quobyte-8ba0d74a-6e74-414e-8624-1ea2e2d574a6" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Lock "cinder-quobyte-8ba0d74a-6e74-414e-8624-1ea2e2d574a6" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb7c915-d83e-4905-8ba8-c6187f50cf1d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:28 devstack sudo[88444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6
Apr 21 02:31:28 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:28 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6" returned: 0 in 0.575s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:28 devstack sudo[88451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6
Apr 21 02:31:28 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (a8632e41-94dd-4ad6-a78e-625f2e9bc684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d632f0-8446-48a4-b803-800770ea5549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81d632f0-8446-48a4-b803-800770ea5549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1420082614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de24f09-89bf-4e22-9c8b-b3531266ff10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:29Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3306bcff-8bbf-4a32-8b82-3791357f445b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3306bcff-8bbf-4a32-8b82-3791357f445b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e6895f-3a76-45f6-9b80-747f97da37dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e6895f-3a76-45f6-9b80-747f97da37dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de24f09-89bf-4e22-9c8b-b3531266ff10', 'volume_name': 'volume-9de24f09-89bf-4e22-9c8b-b3531266ff10', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7daf091a-a68f-4c38-87c9-3c2654e69797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7daf091a-a68f-4c38-87c9-3c2654e69797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3373d9-eeb9-42ae-99c6-c26371514c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:28 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume 9de24f09-89bf-4e22-9c8b-b3531266ff10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de24f09-89bf-4e22-9c8b-b3531266ff10', 'volume_size': 1}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1420082614',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de24f09-89bf-4e22-9c8b-b3531266ff10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:29Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Creating volume 9de24f09-89bf-4e22-9c8b-b3531266ff10 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:28 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:28 devstack sudo[88453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10 1073741824
Apr 21 02:31:28 devstack sudo[88453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (9146b943-d810-4bb0-8c97-665966658f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9931ef2-6c37-4d6c-bd7e-9b93391ccd53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9931ef2-6c37-4d6c-bd7e-9b93391ccd53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909402131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6335510-bb89-4aaf-87b6-dff6b67ed687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:29Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d77a3e-b93a-45e8-bc74-315311f0be2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d77a3e-b93a-45e8-bc74-315311f0be2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e94da5b-28ee-44e4-8dc2-ca124a8fd86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e94da5b-28ee-44e4-8dc2-ca124a8fd86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6335510-bb89-4aaf-87b6-dff6b67ed687', 'volume_name': 'volume-f6335510-bb89-4aaf-87b6-dff6b67ed687', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a13557-9233-4102-9525-02658bbd234a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a13557-9233-4102-9525-02658bbd234a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c56f303-d0b6-4512-8795-e9368e7e984e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:29 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume f6335510-bb89-4aaf-87b6-dff6b67ed687: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6335510-bb89-4aaf-87b6-dff6b67ed687', 'volume_size': 1}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:29 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8ba0d74a-6e74-414e-8624-1ea2e2d574a6" returned: 0 in 1.040s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Lock "cinder-quobyte-8ba0d74a-6e74-414e-8624-1ea2e2d574a6" released by "delete_volume" :: held 1.657s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Created reservations ['151c4e0d-a615-48ef-8923-1293e46857d3', '7bf4ae9e-ccb9-40f8-beb8-8f9ca4c5a850', '598bd45e-5f95-4a49-a520-46da600cb086', '012d2793-64d9-463e-9385-5e1abe1b5946'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (24b084be-8663-4317-a0e3-052e996c62f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ea7a51-29a5-4258-bca6-c80011dc5668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84ea7a51-29a5-4258-bca6-c80011dc5668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-179524644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d02592-0194-4f65-9025-837770f3043b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:30Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdfffc3-166c-4f88-ac6b-e9cf0b7a1134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdfffc3-166c-4f88-ac6b-e9cf0b7a1134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7b01cf-ddfe-4591-93bc-73c83a72e8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e7b01cf-ddfe-4591-93bc-73c83a72e8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5d02592-0194-4f65-9025-837770f3043b', 'volume_name': 'volume-b5d02592-0194-4f65-9025-837770f3043b', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953c1f05-bc37-4485-95e2-5ab63d414f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (953c1f05-bc37-4485-95e2-5ab63d414f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812b16e3-2713-48f7-81ed-db1701bf382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:29 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume b5d02592-0194-4f65-9025-837770f3043b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5d02592-0194-4f65-9025-837770f3043b', 'volume_size': 1}
Apr 21 02:31:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:30 devstack sudo[88453]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10 1073741824" returned: 0 in 1.102s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:30 devstack sudo[88460]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:30 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:30 devstack sudo[88462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10
Apr 21 02:31:30 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (2ff91c45-e134-440d-802e-c1a2d2ebe3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ae30e4-65a1-48cf-b273-8a3bdfeccc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2ae30e4-65a1-48cf-b273-8a3bdfeccc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297006805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ad5045-5426-4400-897d-41e8ad230e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:30Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6c46c9-aa6d-4928-9437-6c1bff4cb9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b6c46c9-aa6d-4928-9437-6c1bff4cb9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a62268-9f43-4f17-baf8-2f6e6b62d6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42a62268-9f43-4f17-baf8-2f6e6b62d6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45ad5045-5426-4400-897d-41e8ad230e64', 'volume_name': 'volume-45ad5045-5426-4400-897d-41e8ad230e64', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe8ebe0-3809-4330-aa6e-c1ee64efaee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe8ebe0-3809-4330-aa6e-c1ee64efaee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2ec30e-2f0b-4820-b826-a5948be79aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:30 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume 45ad5045-5426-4400-897d-41e8ad230e64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45ad5045-5426-4400-897d-41e8ad230e64', 'volume_size': 1}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (74d201bd-2f23-44fb-afb5-ead0cf849d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f42e68-de80-4595-85e6-8a2336036a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:30 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10" returned: 0 in 0.831s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.495s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1909402131',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6335510-bb89-4aaf-87b6-dff6b67ed687,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:29Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Creating volume f6335510-bb89-4aaf-87b6-dff6b67ed687 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:30 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:31 devstack sudo[88466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687 1073741824
Apr 21 02:31:31 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65f42e68-de80-4595-85e6-8a2336036a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491966834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de66692a-9e04-41d5-91f7-8f1000a0c95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:31Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a14cfa-d5da-4dd9-b7ef-a7b2a0f5b3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a14cfa-d5da-4dd9-b7ef-a7b2a0f5b3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cc1e99-077f-48bf-b9a8-a4f2124131fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98cc1e99-077f-48bf-b9a8-a4f2124131fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de66692a-9e04-41d5-91f7-8f1000a0c95d', 'volume_name': 'volume-de66692a-9e04-41d5-91f7-8f1000a0c95d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3d2274-04e0-4160-acfb-d84015779c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab3d2274-04e0-4160-acfb-d84015779c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dad621-72fe-401d-a130-ab17b4d9cc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:31 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume de66692a-9e04-41d5-91f7-8f1000a0c95d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de66692a-9e04-41d5-91f7-8f1000a0c95d', 'volume_size': 1}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db3373d9-eeb9-42ae-99c6-c26371514c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de24f09-89bf-4e22-9c8b-b3531266ff10', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75ee1b8-a447-4321-afab-37fec90ecbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ca027b7e-92e9-4f19-83a9-11c0dde725cf tempest-VolumesActionsTest-371563670 None] Acquiring lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" by "attach_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:31 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume volume-9de24f09-89bf-4e22-9c8b-b3531266ff10 (9de24f09-89bf-4e22-9c8b-b3531266ff10): created successfully
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a75ee1b8-a447-4321-afab-37fec90ecbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (a8632e41-94dd-4ad6-a78e-625f2e9bc684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:31 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 1.191s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:31 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Deleted volume successfully.
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ca027b7e-92e9-4f19-83a9-11c0dde725cf tempest-VolumesActionsTest-371563670 None] Lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" acquired by "attach_volume" :: waited 0.087s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:31 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-8565c9e1-fe5a-4604-ace6-e578095b8a56 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created volume successfully.
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1a93331a-0763-4f75-a700-da2146b52eeb tempest-VolumesMetadataTest-872181271 None] Lock "cinder-8ba0d74a-6e74-414e-8624-1ea2e2d574a6-delete_volume" released by "delete_volume" :: held 3.318s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:31 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ca027b7e-92e9-4f19-83a9-11c0dde725cf tempest-VolumesActionsTest-371563670 None] Attaching volume 44911e6a-2d25-431a-a29e-8d1f75bd5bc3 to instance c9cef4e0-50a3-4fd7-b203-3d6ac204e42c at mountpoint /dev/vdb on host None.
Apr 21 02:31:31 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ca027b7e-92e9-4f19-83a9-11c0dde725cf tempest-VolumesActionsTest-371563670 None] Attach volume completed successfully.
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ca027b7e-92e9-4f19-83a9-11c0dde725cf tempest-VolumesActionsTest-371563670 None] Lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" released by "attach_volume" :: held 0.116s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Flow 'volume_create_manager' (290a9424-f03d-4d31-b6ac-6794489b264e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8ebfb0-d7d7-40a2-953c-2335b8c4760e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a8ebfb0-d7d7-40a2-953c-2335b8c4760e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-160671664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064e8f5c-e910-4ccf-9ffc-c0e7a194e24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b828c66244f446eb76014b3acfad257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:31Z,use_quota=True,user_id='7b092e5fb4f449b8a8c37c3bd0d58c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ae4de0-95f6-40e0-8cee-77a7ccdec2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1ae4de0-95f6-40e0-8cee-77a7ccdec2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c678d625-a603-4a78-b1f2-620b813da562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c678d625-a603-4a78-b1f2-620b813da562) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '064e8f5c-e910-4ccf-9ffc-c0e7a194e24e', 'volume_name': 'volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90eacb0f-dfbb-4627-8ff4-12c7a4f95ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90eacb0f-dfbb-4627-8ff4-12c7a4f95ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd971da-76eb-41f3-97fa-48673a0a14e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:31 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Volume 064e8f5c-e910-4ccf-9ffc-c0e7a194e24e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e', 'volume_size': 1}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f106d73b-ceb5-49ae-81be-ee9d5056879f tempest-VolumesActionsTest-371563670 None] Acquiring lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3-detach_volume" by "detach_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f106d73b-ceb5-49ae-81be-ee9d5056879f tempest-VolumesActionsTest-371563670 None] Lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:31 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f106d73b-ceb5-49ae-81be-ee9d5056879f tempest-VolumesActionsTest-371563670 None] Detaching volume 44911e6a-2d25-431a-a29e-8d1f75bd5bc3 from instance c9cef4e0-50a3-4fd7-b203-3d6ac204e42c.
Apr 21 02:31:31 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687 1073741824" returned: 0 in 0.854s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:31 devstack sudo[88472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687
Apr 21 02:31:31 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:31 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f106d73b-ceb5-49ae-81be-ee9d5056879f tempest-VolumesActionsTest-371563670 None] Detach volume completed successfully.
Apr 21 02:31:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f106d73b-ceb5-49ae-81be-ee9d5056879f tempest-VolumesActionsTest-371563670 None] Lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:32 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687" returned: 0 in 0.491s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.357s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-179524644',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5d02592-0194-4f65-9025-837770f3043b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:30Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Creating volume b5d02592-0194-4f65-9025-837770f3043b {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:32 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c56f303-d0b6-4512-8795-e9368e7e984e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6335510-bb89-4aaf-87b6-dff6b67ed687', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113f48b4-78c8-4d58-b345-cbbb29e30726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:32 devstack sudo[88475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b 1073741824
Apr 21 02:31:32 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:32 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume volume-f6335510-bb89-4aaf-87b6-dff6b67ed687 (f6335510-bb89-4aaf-87b6-dff6b67ed687): created successfully
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113f48b4-78c8-4d58-b345-cbbb29e30726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (9146b943-d810-4bb0-8c97-665966658f84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-fcefe432-8d65-4fa5-b5e5-0745b939c946 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created volume successfully.
Apr 21 02:31:32 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b 1073741824" returned: 0 in 0.591s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:33 devstack sudo[88481]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b
Apr 21 02:31:33 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:33 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b" returned: 0 in 0.486s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.008s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-297006805',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45ad5045-5426-4400-897d-41e8ad230e64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:30Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Creating volume 45ad5045-5426-4400-897d-41e8ad230e64 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:33 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (812b16e3-2713-48f7-81ed-db1701bf382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5d02592-0194-4f65-9025-837770f3043b', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:33 devstack sudo[88484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64 1073741824
Apr 21 02:31:33 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a4d770-6f0d-4dc3-acc7-257bf82ab567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:33 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume volume-b5d02592-0194-4f65-9025-837770f3043b (b5d02592-0194-4f65-9025-837770f3043b): created successfully
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71a4d770-6f0d-4dc3-acc7-257bf82ab567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (24b084be-8663-4317-a0e3-052e996c62f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:33 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e4e3fb21-45b4-460d-a112-56d568de4b29 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created volume successfully.
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Flow 'volume_create_manager' (6afb9c2b-63dd-4ad6-99b7-06fa9d0c376c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de82b8ab-36ae-4dcd-a0b6-90f3e3ece891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de82b8ab-36ae-4dcd-a0b6-90f3e3ece891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-534058128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414c8772-5fe2-4b0e-afa7-4811d9c80127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e1216e8ebc428f998d0b79cbe32b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:34Z,use_quota=True,user_id='97e7a810d4024b74b80f584efc13e798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb609c7-0913-42db-8368-9c5e0f55902f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eb609c7-0913-42db-8368-9c5e0f55902f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2aab9c1-3cb7-45a9-832b-5ad83b65af12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2aab9c1-3cb7-45a9-832b-5ad83b65af12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414c8772-5fe2-4b0e-afa7-4811d9c80127', 'volume_name': 'volume-414c8772-5fe2-4b0e-afa7-4811d9c80127', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdfe275-9702-4346-b47c-4da1ad9cde51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cdfe275-9702-4346-b47c-4da1ad9cde51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a856d82-fd66-4e28-a02d-acf5559a2a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:34 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Volume 414c8772-5fe2-4b0e-afa7-4811d9c80127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414c8772-5fe2-4b0e-afa7-4811d9c80127', 'volume_size': 1}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:34 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64 1073741824" returned: 0 in 0.591s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:34 devstack sudo[88515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64
Apr 21 02:31:34 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:34 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64" returned: 0 in 0.441s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.432s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-491966834',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de66692a-9e04-41d5-91f7-8f1000a0c95d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3415569f40b41e48177d9207a24419e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:31Z,use_quota=True,user_id='251a2af9c3b14491a4d8a19e5ff0171d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Creating volume de66692a-9e04-41d5-91f7-8f1000a0c95d {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:34 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc2ec30e-2f0b-4820-b826-a5948be79aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45ad5045-5426-4400-897d-41e8ad230e64', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebef03e5-60d1-4d3e-81ed-03b43d73009b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:34 devstack sudo[88518]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d 1073741824
Apr 21 02:31:34 devstack sudo[88518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:34 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume volume-45ad5045-5426-4400-897d-41e8ad230e64 (45ad5045-5426-4400-897d-41e8ad230e64): created successfully
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebef03e5-60d1-4d3e-81ed-03b43d73009b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (2ff91c45-e134-440d-802e-c1a2d2ebe3a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:34 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e010544c-74f3-431a-9c4f-56ed42f487c7 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created volume successfully.
Apr 21 02:31:35 devstack sudo[88518]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d 1073741824" returned: 0 in 0.540s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:35 devstack sudo[88524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d
Apr 21 02:31:35 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:35 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d" returned: 0 in 0.484s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.038s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-160671664',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=064e8f5c-e910-4ccf-9ffc-c0e7a194e24e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b828c66244f446eb76014b3acfad257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:31Z,use_quota=True,user_id='7b092e5fb4f449b8a8c37c3bd0d58c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Creating volume 064e8f5c-e910-4ccf-9ffc-c0e7a194e24e {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:35 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=193,cinder:UPDATE=256,cinder:INSERT=72,cinder:DELETE=25 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dad621-72fe-401d-a130-ab17b4d9cc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de66692a-9e04-41d5-91f7-8f1000a0c95d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85e5247-3313-4448-a2ad-1ca54563cfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:35 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Volume volume-de66692a-9e04-41d5-91f7-8f1000a0c95d (de66692a-9e04-41d5-91f7-8f1000a0c95d): created successfully
Apr 21 02:31:35 devstack sudo[88528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e 1073741824
Apr 21 02:31:35 devstack sudo[88528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b85e5247-3313-4448-a2ad-1ca54563cfa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Flow 'volume_create_manager' (74d201bd-2f23-44fb-afb5-ead0cf849d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:35 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-8da2d760-f183-4f83-8130-f7a6e4563d4c tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created volume successfully.
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-de66692a-9e04-41d5-91f7-8f1000a0c95d-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-de66692a-9e04-41d5-91f7-8f1000a0c95d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:36 devstack sudo[88528]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=207,cinder:DELETE=18,cinder:INSERT=69,cinder:UPDATE=265 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e 1073741824" returned: 0 in 0.562s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-quobyte-de66692a-9e04-41d5-91f7-8f1000a0c95d" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-de66692a-9e04-41d5-91f7-8f1000a0c95d" acquired by "delete_volume" :: waited 0.023s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:36 devstack sudo[88534]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e
Apr 21 02:31:36 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f611818-3e01-4cbf-a0df-f6c9ba6a0e59]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:36 devstack sudo[88536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d
Apr 21 02:31:36 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:36 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e" returned: 0 in 0.471s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.077s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.650s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-534058128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=414c8772-5fe2-4b0e-afa7-4811d9c80127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e1216e8ebc428f998d0b79cbe32b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:34Z,use_quota=True,user_id='97e7a810d4024b74b80f584efc13e798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Creating volume 414c8772-5fe2-4b0e-afa7-4811d9c80127 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:36 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:36 devstack sudo[88542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127 1073741824
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fd971da-76eb-41f3-97fa-48673a0a14e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:36 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4bb78d6-8ee8-4061-93ff-10dbbb6d87b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:36 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Volume volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e (064e8f5c-e910-4ccf-9ffc-c0e7a194e24e): created successfully
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4bb78d6-8ee8-4061-93ff-10dbbb6d87b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Flow 'volume_create_manager' (290a9424-f03d-4d31-b6ac-6794489b264e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:36 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:36 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f9f8e911-c0af-42f4-a4da-900dbaaa44ed tempest-VolumesSnapshotTestJSON-171365862 None] Created volume successfully.
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d" returned: 0 in 0.518s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:36 devstack sudo[88544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d
Apr 21 02:31:36 devstack sudo[88544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:37 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127 1073741824" returned: 0 in 0.503s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:37 devstack sudo[88544]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-de66692a-9e04-41d5-91f7-8f1000a0c95d" returned: 0 in 0.451s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-de66692a-9e04-41d5-91f7-8f1000a0c95d" released by "delete_volume" :: held 0.996s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:37 devstack sudo[88550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127
Apr 21 02:31:37 devstack sudo[88550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created reservations ['f681cb12-19a7-445b-9f39-80b36be239b3', 'f13e4074-24ca-4650-9a94-fc8c183fd1c9', '5f9e6906-08e1-47de-8d00-c9fcf3935c8e', 'edecadc8-e270-4865-8413-d6c88bee3669'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:37 devstack sudo[88552]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:37 devstack sudo[88552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:37 devstack sudo[88550]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127" returned: 0 in 0.439s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a856d82-fd66-4e28-a02d-acf5559a2a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414c8772-5fe2-4b0e-afa7-4811d9c80127', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c21466-2bf7-4300-8cda-31539e35127c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:37 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Volume volume-414c8772-5fe2-4b0e-afa7-4811d9c80127 (414c8772-5fe2-4b0e-afa7-4811d9c80127): created successfully
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c21466-2bf7-4300-8cda-31539e35127c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Flow 'volume_create_manager' (6afb9c2b-63dd-4ad6-99b7-06fa9d0c376c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:37 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1a25e132-627d-46a8-8e22-1dfbd96af4f9 tempest-VolumesTransfersTest-1241776918 None] Created volume successfully.
Apr 21 02:31:37 devstack sudo[88552]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.442s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:37 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Deleted volume successfully.
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d16dc28-2a6f-436d-b81a-b7d0ddbb209e tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-de66692a-9e04-41d5-91f7-8f1000a0c95d-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] Creating offline snapshot d3df2d94-c29f-4808-81c5-6e0acceb55c0 of volume 064e8f5c-e910-4ccf-9ffc-c0e7a194e24e {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0156dcc-00fc-4f1e-933b-b3cc0f91a7db]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:38 devstack sudo[88556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e
Apr 21 02:31:38 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-45ad5045-5426-4400-897d-41e8ad230e64-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-45ad5045-5426-4400-897d-41e8ad230e64-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-quobyte-45ad5045-5426-4400-897d-41e8ad230e64" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-45ad5045-5426-4400-897d-41e8ad230e64" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:38 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dbae88-93b9-46f1-aa88-316e46078b2c]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:38 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-891ee7c2-e122-46a0-a216-4189cf267708 tempest-VolumesTransfersTest-2099026257 None] Transfer volume completed successfully.
Apr 21 02:31:38 devstack sudo[88560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64
Apr 21 02:31:38 devstack sudo[88560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:38 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e" returned: 0 in 0.578s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:38 devstack sudo[88563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0 1G
Apr 21 02:31:38 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:38 devstack sudo[88560]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64" returned: 0 in 0.494s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:38 devstack sudo[88571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64
Apr 21 02:31:38 devstack sudo[88571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:39 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0 1G" returned: 0 in 0.484s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:39 devstack sudo[88573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0
Apr 21 02:31:39 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Acquiring lock "cinder-414c8772-5fe2-4b0e-afa7-4811d9c80127-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Lock "cinder-414c8772-5fe2-4b0e-afa7-4811d9c80127-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Acquiring lock "cinder-quobyte-414c8772-5fe2-4b0e-afa7-4811d9c80127" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Lock "cinder-quobyte-414c8772-5fe2-4b0e-afa7-4811d9c80127" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[6302dbaf-aa08-4b97-9b1a-80d6b03008e0]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:39 devstack sudo[88576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127
Apr 21 02:31:39 devstack sudo[88576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:39 devstack sudo[88571]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-45ad5045-5426-4400-897d-41e8ad230e64" returned: 0 in 0.471s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-45ad5045-5426-4400-897d-41e8ad230e64" released by "delete_volume" :: held 0.989s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created reservations ['4ddb3f79-3457-417a-8b18-f631948913f6', '1cbc54a0-0660-42d3-af6e-3e82146b4d5b', 'ce44a6f8-5b72-4837-97e1-abfe9be7bd97', '1068e807-6479-40eb-bbb1-30d43dedd4f7'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:39 devstack sudo[88581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:39 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:39 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0" returned: 0 in 0.540s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:39 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0 is being set with open permissions: ugo+rw
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:39 devstack sudo[88583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0
Apr 21 02:31:39 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:39 devstack sudo[88576]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127" returned: 0 in 0.567s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:39 devstack sudo[88589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127
Apr 21 02:31:39 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:39 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.455s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:39 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Deleted volume successfully.
Apr 21 02:31:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ca5c8e8-3417-433c-b901-f8dcc4f7f6ce tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-45ad5045-5426-4400-897d-41e8ad230e64-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:40 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0" returned: 0 in 0.522s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:40 devstack sudo[88592]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.info
Apr 21 02:31:40 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:40 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-414c8772-5fe2-4b0e-afa7-4811d9c80127" returned: 0 in 0.511s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Lock "cinder-quobyte-414c8772-5fe2-4b0e-afa7-4811d9c80127" released by "delete_volume" :: held 1.098s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Created reservations ['e81b45fc-0796-48e4-88b5-df6221a18f81', '15363480-0e30-427b-8665-387090be2326', 'd73f7651-7f48-4ca4-996b-c71edca42ddd', 'edebe4d3-2f89-49ef-8194-b21d23cbe3ea'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:40 devstack sudo[88598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:40 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-b5d02592-0194-4f65-9025-837770f3043b-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-b5d02592-0194-4f65-9025-837770f3043b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-quobyte-b5d02592-0194-4f65-9025-837770f3043b" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-b5d02592-0194-4f65-9025-837770f3043b" acquired by "delete_volume" :: waited 0.019s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[31fe8536-f732-4d26-aafa-37a7e2cea21b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:40 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.info" returned: 0 in 0.493s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:40 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.info is being set with open permissions: ugo+rw
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:40 devstack sudo[88601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b
Apr 21 02:31:40 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:40 devstack sudo[88602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.info
Apr 21 02:31:40 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:40 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.461s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:40 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Deleted volume successfully.
Apr 21 02:31:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8d53c482-867f-4c99-9580-3558e2d8e8e0 tempest-VolumesTransfersTest-1414377901 None] Lock "cinder-414c8772-5fe2-4b0e-afa7-4811d9c80127-delete_volume" released by "delete_volume" :: held 1.715s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:41 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:41 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.info" returned: 0 in 0.454s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b" returned: 0 in 0.511s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.130s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:41 devstack sudo[88611]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b
Apr 21 02:31:41 devstack sudo[88611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:41 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6842b660-1a6c-4181-b5cc-43283a43172f tempest-VolumesSnapshotTestJSON-171365862 None] Create snapshot completed successfully
Apr 21 02:31:41 devstack sudo[88611]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b5d02592-0194-4f65-9025-837770f3043b" returned: 0 in 0.464s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-b5d02592-0194-4f65-9025-837770f3043b" released by "delete_volume" :: held 1.009s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created reservations ['009d27d5-7a8f-4609-aa82-10b3d7d6ecc9', '703ad566-e57f-4d86-b296-18fcb339991f', '0adeb19f-b590-45a1-8ade-a83c5d0bbfb8', 'c803c805-0cce-4f93-a7bb-0ad6bfc7486b'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:41 devstack sudo[88615]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:41 devstack sudo[88615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Flow 'volume_create_manager' (0e6a85ea-b1ac-44de-ab9f-24ff6222cef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e31f601-4be5-4759-81aa-bbc138b3f87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e31f601-4be5-4759-81aa-bbc138b3f87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-575434889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e969b0a-6518-444f-84d2-98c98c7b3e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e1216e8ebc428f998d0b79cbe32b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:42Z,use_quota=True,user_id='97e7a810d4024b74b80f584efc13e798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3928ab2e-7197-49b9-8b35-2c55265c2b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3928ab2e-7197-49b9-8b35-2c55265c2b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f5c6a0-2292-4715-bcd4-74d7c2b3a2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f5c6a0-2292-4715-bcd4-74d7c2b3a2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e969b0a-6518-444f-84d2-98c98c7b3e60', 'volume_name': 'volume-0e969b0a-6518-444f-84d2-98c98c7b3e60', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618e20bb-4f01-4300-95f6-061cbc380391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (618e20bb-4f01-4300-95f6-061cbc380391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc10851f-9858-45ef-9ee2-f3434c72883d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:41 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Volume 0e969b0a-6518-444f-84d2-98c98c7b3e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e969b0a-6518-444f-84d2-98c98c7b3e60', 'volume_size': 1}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-575434889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e969b0a-6518-444f-84d2-98c98c7b3e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e1216e8ebc428f998d0b79cbe32b1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:42Z,use_quota=True,user_id='97e7a810d4024b74b80f584efc13e798',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Creating volume 0e969b0a-6518-444f-84d2-98c98c7b3e60 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:41 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:41 devstack sudo[88617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60 1073741824
Apr 21 02:31:41 devstack sudo[88617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:42 devstack sudo[88615]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.417s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:42 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Deleted volume successfully.
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aeafa86c-4e7e-4837-a0b2-3a64c875e330 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-b5d02592-0194-4f65-9025-837770f3043b-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-d3df2d94-c29f-4808-81c5-6e0acceb55c0-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-d3df2d94-c29f-4808-81c5-6e0acceb55c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-d3df2d94-c29f-4808-81c5-6e0acceb55c0" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-d3df2d94-c29f-4808-81c5-6e0acceb55c0" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Deleting offline snapshot d3df2d94-c29f-4808-81c5-6e0acceb55c0 of volume 064e8f5c-e910-4ccf-9ffc-c0e7a194e24e {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] snapshot_file for this snap is: volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c6cf24-d732-48e9-a58d-26fd5f233740]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:42 devstack sudo[88617]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60 1073741824" returned: 0 in 0.562s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:42 devstack sudo[88623]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0
Apr 21 02:31:42 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:42 devstack sudo[88624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60
Apr 21 02:31:42 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-f6335510-bb89-4aaf-87b6-dff6b67ed687-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-f6335510-bb89-4aaf-87b6-dff6b67ed687-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-quobyte-f6335510-bb89-4aaf-87b6-dff6b67ed687" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-f6335510-bb89-4aaf-87b6-dff6b67ed687" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f81a04f-f002-45b3-b3e5-2eb92d492351]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:42 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60" returned: 0 in 0.469s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:42 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0" returned: 0 in 0.547s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:42 devstack sudo[88631]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687
Apr 21 02:31:42 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc10851f-9858-45ef-9ee2-f3434c72883d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e969b0a-6518-444f-84d2-98c98c7b3e60', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b38aef1-feaa-4975-8ef0-7cad880dc3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:31:42 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Volume volume-0e969b0a-6518-444f-84d2-98c98c7b3e60 (0e969b0a-6518-444f-84d2-98c98c7b3e60): created successfully
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b38aef1-feaa-4975-8ef0-7cad880dc3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Flow 'volume_create_manager' (0e6a85ea-b1ac-44de-ab9f-24ff6222cef8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff53af9-ea3d-4186-a519-4298c36cc793]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:42 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-02979e46-d4f6-44ca-8778-65d307cc3ad8 tempest-VolumesTransfersTest-1241776918 None] Created volume successfully.
Apr 21 02:31:42 devstack sudo[88633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e
Apr 21 02:31:42 devstack sudo[88633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:43 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687" returned: 0 in 0.485s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:43 devstack sudo[88638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687
Apr 21 02:31:43 devstack sudo[88638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:43 devstack sudo[88633]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e" returned: 0 in 0.503s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:43 devstack sudo[88643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0
Apr 21 02:31:43 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:43 devstack sudo[88638]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f6335510-bb89-4aaf-87b6-dff6b67ed687" returned: 0 in 0.411s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-f6335510-bb89-4aaf-87b6-dff6b67ed687" released by "delete_volume" :: held 0.923s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created reservations ['c50c9d97-06cd-453e-9306-687753e0efe1', 'b85009c9-bc41-47e4-99c0-2e5fb5b0c273', '7bedac1b-dac0-4ff2-b92c-14bfdc83254f', 'db73af93-fc5f-4821-ac65-99b4febfc662'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:43 devstack sudo[88649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:43 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-9de24f09-89bf-4e22-9c8b-b3531266ff10-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-9de24f09-89bf-4e22-9c8b-b3531266ff10-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:43 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0" returned: 0 in 0.507s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:43 devstack sudo[88651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0
Apr 21 02:31:43 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-quobyte-9de24f09-89bf-4e22-9c8b-b3531266ff10" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-9de24f09-89bf-4e22-9c8b-b3531266ff10" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaebcd3-46c1-4b2a-a098-cfe23187b0b6]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:44 devstack sudo[88653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10
Apr 21 02:31:44 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Acquiring lock "cinder-0e969b0a-6518-444f-84d2-98c98c7b3e60-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Lock "cinder-0e969b0a-6518-444f-84d2-98c98c7b3e60-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Acquiring lock "cinder-quobyte-0e969b0a-6518-444f-84d2-98c98c7b3e60" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Lock "cinder-quobyte-0e969b0a-6518-444f-84d2-98c98c7b3e60" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b17e2c-335a-4171-810d-2df858fafbea]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:44 devstack sudo[88655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60
Apr 21 02:31:44 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:44 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.530s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:44 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Deleted volume successfully.
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e4b2e3f5-4b8e-46bc-aca8-509fa161286d tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-f6335510-bb89-4aaf-87b6-dff6b67ed687-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:44 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e.d3df2d94-c29f-4808-81c5-6e0acceb55c0" returned: 0 in 0.514s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-d3df2d94-c29f-4808-81c5-6e0acceb55c0" released by "_delete_snapshot" :: held 2.143s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e" released by "delete_snapshot" :: held 2.153s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Created reservations ['3e42fe4d-fa3c-4a31-b02c-70c913751e2b', '9eb06f85-b439-46df-996f-e38a42984def', '25142e1a-189e-4eea-967d-a32d69d5a579', '7414a5b4-ce52-4f1c-9185-cceabc9bab1a'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:44 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10" returned: 0 in 0.528s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:44 devstack sudo[88662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10
Apr 21 02:31:44 devstack sudo[88662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:44 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Delete snapshot completed successfully.
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c5a020f7-8ae4-46d3-bb7d-606966625baa tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-d3df2d94-c29f-4808-81c5-6e0acceb55c0-delete_snapshot" released by "delete_snapshot" :: held 2.271s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:44 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60" returned: 0 in 0.560s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:44 devstack sudo[88667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60
Apr 21 02:31:44 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:44 devstack sudo[88662]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9de24f09-89bf-4e22-9c8b-b3531266ff10" returned: 0 in 0.442s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-9de24f09-89bf-4e22-9c8b-b3531266ff10" released by "delete_volume" :: held 0.990s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:44 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created reservations ['10d9d765-72c3-46d2-88e8-b17befda5532', 'f84a40f8-ab58-433f-80db-017e7caefa68', '8c4b3333-1b57-4304-ba88-5edf7fc49aa0', '07f95bc8-a74e-4918-91c0-31e9eacc3370'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:45 devstack sudo[88670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:45 devstack sudo[88670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:45 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0e969b0a-6518-444f-84d2-98c98c7b3e60" returned: 0 in 0.528s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Lock "cinder-quobyte-0e969b0a-6518-444f-84d2-98c98c7b3e60" released by "delete_volume" :: held 1.112s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Created reservations ['a3b19fd0-f493-4184-9793-d7ce25851b2f', 'b838880f-18d3-4c1c-958b-83d526623545', '5e2b75fc-c9b0-4456-b3a3-6cf317c4122f', '90e2097e-5f1a-40a1-a369-6517d06ec531'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:45 devstack sudo[88673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:45 devstack sudo[88673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:45 devstack sudo[88670]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.480s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:45 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Deleted volume successfully.
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9841f813-fcb6-4593-9940-346e0e4f4d22 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-9de24f09-89bf-4e22-9c8b-b3531266ff10-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Flow 'volume_create_manager' (22debf18-a97c-4991-a884-2e07a9a0f9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2077ec5e-5d96-495d-a8bc-2dc9beb9a8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2077ec5e-5d96-495d-a8bc-2dc9beb9a8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-686743291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9704371-fadd-4e0d-bfd9-1449aea520b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b828c66244f446eb76014b3acfad257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:46Z,use_quota=True,user_id='7b092e5fb4f449b8a8c37c3bd0d58c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971c2cf5-fba4-4c5d-8185-b6cf7a0a3d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971c2cf5-fba4-4c5d-8185-b6cf7a0a3d4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c925b17-4082-4aa7-acb5-9a18e598fd9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c925b17-4082-4aa7-acb5-9a18e598fd9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9704371-fadd-4e0d-bfd9-1449aea520b6', 'volume_name': 'volume-e9704371-fadd-4e0d-bfd9-1449aea520b6', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837b3da8-fbe7-42de-8d7f-ad9e49f5a151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837b3da8-fbe7-42de-8d7f-ad9e49f5a151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ab21e9-8448-4947-9cd2-c673d9dca27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:45 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Volume e9704371-fadd-4e0d-bfd9-1449aea520b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9704371-fadd-4e0d-bfd9-1449aea520b6', 'volume_size': 1}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-686743291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9704371-fadd-4e0d-bfd9-1449aea520b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b828c66244f446eb76014b3acfad257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:46Z,use_quota=True,user_id='7b092e5fb4f449b8a8c37c3bd0d58c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Creating volume e9704371-fadd-4e0d-bfd9-1449aea520b6 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:45 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:45 devstack sudo[88673]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.539s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:45 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Deleted volume successfully.
Apr 21 02:31:45 devstack sudo[88677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 1073741824
Apr 21 02:31:45 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f5d0569b-fdcf-46cf-996c-3fa9dd3d832b tempest-VolumesTransfersTest-1414377901 None] Lock "cinder-0e969b0a-6518-444f-84d2-98c98c7b3e60-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-f83487fd-b9be-4d72-951a-8ce850a23c23-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-f83487fd-b9be-4d72-951a-8ce850a23c23-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "cinder-quobyte-f83487fd-b9be-4d72-951a-8ce850a23c23" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-f83487fd-b9be-4d72-951a-8ce850a23c23" acquired by "delete_volume" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bd61a9-4d1c-4ae5-a25c-0cd7eef2bed2]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:46 devstack sudo[88680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23
Apr 21 02:31:46 devstack sudo[88680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:46 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 1073741824" returned: 0 in 0.643s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:46 devstack sudo[88685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6
Apr 21 02:31:46 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:46 devstack sudo[88680]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23" returned: 0 in 0.565s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:46 devstack sudo[88694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23
Apr 21 02:31:46 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:46 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6" returned: 0 in 0.507s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ab21e9-8448-4947-9cd2-c673d9dca27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9704371-fadd-4e0d-bfd9-1449aea520b6', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9ce9fa-79b1-4a5c-848c-4ecd6be86342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:47 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Volume volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 (e9704371-fadd-4e0d-bfd9-1449aea520b6): created successfully
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f9ce9fa-79b1-4a5c-848c-4ecd6be86342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Flow 'volume_create_manager' (22debf18-a97c-4991-a884-2e07a9a0f9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:47 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-26b8512c-fbb5-4796-b97a-4db35b801ee9 tempest-VolumesSnapshotTestJSON-171365862 None] Created volume successfully.
Apr 21 02:31:47 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-f83487fd-b9be-4d72-951a-8ce850a23c23" returned: 0 in 0.627s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-quobyte-f83487fd-b9be-4d72-951a-8ce850a23c23" released by "delete_volume" :: held 1.212s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Created reservations ['7573662a-65ac-436c-9c7d-0fbad2a4f28a', '4c27483f-6d55-4977-9e7e-82815afebdb5', 'd93af623-ae58-48e2-8566-75159015ae3e', '2c058cf1-741c-4d7c-8418-f8560eba45b6'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:47 devstack sudo[88709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:47 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:47 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.476s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:47 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Deleted volume successfully.
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9862b817-86fc-4f13-b323-66000a3d1600 tempest-CreateVolumesFromSourceVolumeTest-339343443 None] Lock "cinder-f83487fd-b9be-4d72-951a-8ce850a23c23-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] Creating offline snapshot f2ffe107-f614-4b94-b70a-247cc27679c0 of volume e9704371-fadd-4e0d-bfd9-1449aea520b6 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[617b5301-770d-4d29-a2c3-28d0d048bda4]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:48 devstack sudo[88712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6
Apr 21 02:31:48 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:48 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6" returned: 0 in 0.633s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:48 devstack sudo[88718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0 1G
Apr 21 02:31:48 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:49 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0 1G" returned: 0 in 0.636s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:49 devstack sudo[88723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0
Apr 21 02:31:49 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:49 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0" returned: 0 in 0.495s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:49 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0 is being set with open permissions: ugo+rw
Apr 21 02:31:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:49 devstack sudo[88731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0
Apr 21 02:31:49 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:50 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0" returned: 0 in 0.436s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:50 devstack sudo[88734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.info
Apr 21 02:31:50 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:50 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.info" returned: 0 in 0.415s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:50 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.info is being set with open permissions: ugo+rw
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:50 devstack sudo[88737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.info
Apr 21 02:31:50 devstack sudo[88737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Flow 'volume_create_manager' (212c3c30-ebfc-4c99-ac58-58bd500017e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a79390c-c4b7-4598-95e0-9575c90494ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a79390c-c4b7-4598-95e0-9575c90494ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1814034967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160ec44c-f8cc-48b5-a718-312b397aad45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25dbc66963141ac9767aae30fe75a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:51Z,use_quota=True,user_id='2cf65f6ab99148469c9dd33327d420df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bfd8ce-0e7b-4f36-86b6-eb955fa076d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2bfd8ce-0e7b-4f36-86b6-eb955fa076d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867f8537-83fa-4e3b-a005-0ed10276ee84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (867f8537-83fa-4e3b-a005-0ed10276ee84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '160ec44c-f8cc-48b5-a718-312b397aad45', 'volume_name': 'volume-160ec44c-f8cc-48b5-a718-312b397aad45', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5dd782-e4a9-40e1-970c-4169c3cf624c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c5dd782-e4a9-40e1-970c-4169c3cf624c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed86c9c-3337-43da-a581-a8549534e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:50 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Volume 160ec44c-f8cc-48b5-a718-312b397aad45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-160ec44c-f8cc-48b5-a718-312b397aad45', 'volume_size': 1}
Apr 21 02:31:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:51 devstack sudo[88737]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.info" returned: 0 in 0.521s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.206s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1814034967',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=160ec44c-f8cc-48b5-a718-312b397aad45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25dbc66963141ac9767aae30fe75a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:51Z,use_quota=True,user_id='2cf65f6ab99148469c9dd33327d420df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Creating volume 160ec44c-f8cc-48b5-a718-312b397aad45 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:51 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:51 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b4dc63bd-d41a-4101-9070-03bf87631769 tempest-VolumesSnapshotTestJSON-171365862 None] Create snapshot completed successfully
Apr 21 02:31:51 devstack sudo[88771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45 1073741824
Apr 21 02:31:51 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:51 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45 1073741824" returned: 0 in 0.585s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:51 devstack sudo[88779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45
Apr 21 02:31:51 devstack sudo[88779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:52 devstack sudo[88779]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45" returned: 0 in 0.475s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ed86c9c-3337-43da-a581-a8549534e807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-160ec44c-f8cc-48b5-a718-312b397aad45', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b6f8df-e6c7-47bc-ba18-388b670a7efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:52 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Volume volume-160ec44c-f8cc-48b5-a718-312b397aad45 (160ec44c-f8cc-48b5-a718-312b397aad45): created successfully
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57b6f8df-e6c7-47bc-ba18-388b670a7efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Flow 'volume_create_manager' (212c3c30-ebfc-4c99-ac58-58bd500017e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:52 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-7e0258c1-291a-4a59-ab8c-28c307453561 tempest-VolumesTransfersV355Test-160305886 None] Created volume successfully.
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Flow 'volume_create_manager' (5bdc267c-d381-4843-97c3-dc5041b6ea50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65821501-591a-4a24-ac02-70b095383722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65821501-591a-4a24-ac02-70b095383722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1714729767',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17fc5133-f844-415e-8f76-d5f668f454eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b828c66244f446eb76014b3acfad257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:52Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=f2ffe107-f614-4b94-b70a-247cc27679c0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:52Z,use_quota=True,user_id='7b092e5fb4f449b8a8c37c3bd0d58c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8362112c-df8f-41e5-9aa2-ce9318c47b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8362112c-df8f-41e5-9aa2-ce9318c47b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7aaeee-313a-417a-a31f-87f120ea8cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7aaeee-313a-417a-a31f-87f120ea8cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '17fc5133-f844-415e-8f76-d5f668f454eb', 'volume_name': 'volume-17fc5133-f844-415e-8f76-d5f668f454eb', 'volume_size': 2, 'snapshot_id': 'f2ffe107-f614-4b94-b70a-247cc27679c0'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7894eeb7-789e-4251-8d25-3ca09378e322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7894eeb7-789e-4251-8d25-3ca09378e322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83fc721a-2e0c-455a-91e7-4325c8aa60d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:52 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Volume 17fc5133-f844-415e-8f76-d5f668f454eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-17fc5133-f844-415e-8f76-d5f668f454eb', 'volume_size': 2, 'snapshot_id': 'f2ffe107-f614-4b94-b70a-247cc27679c0'}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-f2ffe107-f614-4b94-b70a-247cc27679c0-17fc5133-f844-415e-8f76-d5f668f454eb" by "_create_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-f2ffe107-f614-4b94-b70a-247cc27679c0-17fc5133-f844-415e-8f76-d5f668f454eb" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Creating volume 17fc5133-f844-415e-8f76-d5f668f454eb from snapshot f2ffe107-f614-4b94-b70a-247cc27679c0 {{(pid=82686) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-17fc5133-f844-415e-8f76-d5f668f454eb" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-17fc5133-f844-415e-8f76-d5f668f454eb" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] snapshot: f2ffe107-f614-4b94-b70a-247cc27679c0, volume: 17fc5133-f844-415e-8f76-d5f668f454eb,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7370e515-9c15-4322-8fe1-0f0f21430db2]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:52 devstack sudo[88782]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0
Apr 21 02:31:52 devstack sudo[88782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:53 devstack sudo[88782]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0" returned: 0 in 0.528s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9704371-fadd-4e0d-bfd9-1449aea520b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[11adf89e-7c9a-4c4d-8845-9432c7d8a7cc]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:53 devstack sudo[88787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6
Apr 21 02:31:53 devstack sudo[88787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9700b27d-d2dc-4ab9-b482-4b719aeca8e4 tempest-VolumesTransfersV355Test-746522787 None] Transfer volume completed successfully.
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c0935e43-8c82-4569-aa6a-26e65d4cd2aa tempest-VolumesActionsTest-371563670 None] Acquiring lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" by "attach_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c0935e43-8c82-4569-aa6a-26e65d4cd2aa tempest-VolumesActionsTest-371563670 None] Lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" acquired by "attach_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c0935e43-8c82-4569-aa6a-26e65d4cd2aa tempest-VolumesActionsTest-371563670 None] Attaching volume 44911e6a-2d25-431a-a29e-8d1f75bd5bc3 to instance 7f2eaf78-7a08-4641-b751-908e2b90d2cd at mountpoint /dev/vdb on host None.
Apr 21 02:31:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c0935e43-8c82-4569-aa6a-26e65d4cd2aa tempest-VolumesActionsTest-371563670 None] Attach volume completed successfully.
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c0935e43-8c82-4569-aa6a-26e65d4cd2aa tempest-VolumesActionsTest-371563670 None] Lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" released by "attach_volume" :: held 0.058s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:53 devstack sudo[88787]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6" returned: 0 in 0.597s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:53 devstack sudo[88792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb
Apr 21 02:31:53 devstack sudo[88792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-92235474-891b-470d-ab3b-d78224a9ab89 tempest-VolumesActionsTest-371563670 None] Acquiring lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3-detach_volume" by "detach_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-92235474-891b-470d-ab3b-d78224a9ab89 tempest-VolumesActionsTest-371563670 None] Lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-92235474-891b-470d-ab3b-d78224a9ab89 tempest-VolumesActionsTest-371563670 None] Detaching volume 44911e6a-2d25-431a-a29e-8d1f75bd5bc3 from instance 7f2eaf78-7a08-4641-b751-908e2b90d2cd.
Apr 21 02:31:54 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-92235474-891b-470d-ab3b-d78224a9ab89 tempest-VolumesActionsTest-371563670 None] Detach volume completed successfully.
Apr 21 02:31:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-92235474-891b-470d-ab3b-d78224a9ab89 tempest-VolumesActionsTest-371563670 None] Lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Acquiring lock "cinder-160ec44c-f8cc-48b5-a718-312b397aad45-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Lock "cinder-160ec44c-f8cc-48b5-a718-312b397aad45-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Acquiring lock "cinder-quobyte-160ec44c-f8cc-48b5-a718-312b397aad45" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Lock "cinder-quobyte-160ec44c-f8cc-48b5-a718-312b397aad45" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:54 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b0c951-9c8f-4750-9e1a-3c5a12415a99]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:54 devstack sudo[88795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45
Apr 21 02:31:54 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:55 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45" returned: 0 in 1.464s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:55 devstack sudo[88810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45
Apr 21 02:31:55 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:56 devstack sudo[88792]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb" returned: 0 in 2.755s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa65e328-d19c-491e-ad2c-85a8df71b38e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:56 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-160ec44c-f8cc-48b5-a718-312b397aad45" returned: 0 in 0.923s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Lock "cinder-quobyte-160ec44c-f8cc-48b5-a718-312b397aad45" released by "delete_volume" :: held 2.419s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Created reservations ['a2ff3f64-a271-464c-b7f4-a4a469d3c9dd', 'd7e17c32-a1b7-4b2a-81fc-1d422a3eaf53', 'fd16818c-68b2-4d32-ac62-2cf37ba96699', '56d59a44-35fc-4f91-a9cd-1ab7ad90bb9c'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:56 devstack sudo[88841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6
Apr 21 02:31:56 devstack sudo[88841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:56 devstack sudo[88844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:56 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:56 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.393s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:56 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Deleted volume successfully.
Apr 21 02:31:56 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53c32e1f-b2d0-4348-9b51-17316250b665 tempest-VolumesTransfersV355Test-596678675 None] Lock "cinder-160ec44c-f8cc-48b5-a718-312b397aad45-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:57 devstack sudo[88841]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6" returned: 0 in 0.708s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6, size 1024.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:31:57 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Converted 1024.00 MB image at 371.45 MB/s
Apr 21 02:31:57 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb is being set with open permissions: ugo+rw
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:57 devstack sudo[88850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb
Apr 21 02:31:57 devstack sudo[88850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:57 devstack sudo[88850]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb" returned: 0 in 0.515s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-17fc5133-f844-415e-8f76-d5f668f454eb" released by "_copy_volume_from_snapshot" :: held 5.172s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Flow 'volume_create_manager' (651fcd2f-b284-4335-a00e-d60fdf6c7ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc7ee21-5348-49c4-83dd-22a683885c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-f2ffe107-f614-4b94-b70a-247cc27679c0-17fc5133-f844-415e-8f76-d5f668f454eb" released by "_create_volume_from_snapshot" :: held 5.214s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.222s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc7ee21-5348-49c4-83dd-22a683885c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-42584045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea608bfe-4810-4452-8284-5cb9c343a07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25dbc66963141ac9767aae30fe75a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:58Z,use_quota=True,user_id='2cf65f6ab99148469c9dd33327d420df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23931f6d-9d16-439d-b826-a51f7dd0062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23931f6d-9d16-439d-b826-a51f7dd0062f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f1dd98-ccb0-4c4f-a6e9-7c22125d4fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23f1dd98-ccb0-4c4f-a6e9-7c22125d4fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea608bfe-4810-4452-8284-5cb9c343a07c', 'volume_name': 'volume-ea608bfe-4810-4452-8284-5cb9c343a07c', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9473ea5a-6944-4793-8499-4953876f411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9473ea5a-6944-4793-8499-4953876f411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7567516-a7bb-4fb1-86f9-e079fd63eef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:57 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Volume ea608bfe-4810-4452-8284-5cb9c343a07c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea608bfe-4810-4452-8284-5cb9c343a07c', 'volume_size': 1}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-42584045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea608bfe-4810-4452-8284-5cb9c343a07c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e25dbc66963141ac9767aae30fe75a05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:31:58Z,use_quota=True,user_id='2cf65f6ab99148469c9dd33327d420df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Creating volume ea608bfe-4810-4452-8284-5cb9c343a07c {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:31:57 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83fc721a-2e0c-455a-91e7-4325c8aa60d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17fc5133-f844-415e-8f76-d5f668f454eb', 'volume_size': 2, 'snapshot_id': 'f2ffe107-f614-4b94-b70a-247cc27679c0'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9091ae6-d870-44fb-aa9b-ee5dd88e18f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:57 devstack sudo[88855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c 1073741824
Apr 21 02:31:57 devstack sudo[88855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:57 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Volume volume-17fc5133-f844-415e-8f76-d5f668f454eb (17fc5133-f844-415e-8f76-d5f668f454eb): created successfully
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9091ae6-d870-44fb-aa9b-ee5dd88e18f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Flow 'volume_create_manager' (5bdc267c-d381-4843-97c3-dc5041b6ea50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:57 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-34f541a5-547f-4193-94bb-804b75d54452 tempest-VolumesSnapshotTestJSON-171365862 None] Created volume successfully.
Apr 21 02:31:58 devstack sudo[88855]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c 1073741824" returned: 0 in 0.509s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:58 devstack sudo[88892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c
Apr 21 02:31:58 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-17fc5133-f844-415e-8f76-d5f668f454eb-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-17fc5133-f844-415e-8f76-d5f668f454eb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-17fc5133-f844-415e-8f76-d5f668f454eb" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-17fc5133-f844-415e-8f76-d5f668f454eb" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ae2962-7ff7-4e73-81f9-524b4de4269b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:58 devstack sudo[88896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb
Apr 21 02:31:58 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:58 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c" returned: 0 in 0.465s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7567516-a7bb-4fb1-86f9-e079fd63eef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea608bfe-4810-4452-8284-5cb9c343a07c', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868eb6f1-233b-475c-8345-169fa70a5bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:31:58 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Volume volume-ea608bfe-4810-4452-8284-5cb9c343a07c (ea608bfe-4810-4452-8284-5cb9c343a07c): created successfully
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (868eb6f1-233b-475c-8345-169fa70a5bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Flow 'volume_create_manager' (651fcd2f-b284-4335-a00e-d60fdf6c7ae0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:31:58 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f35c3878-da11-4ea2-b8e9-c9c4fe365ce9 tempest-VolumesTransfersV355Test-160305886 None] Created volume successfully.
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb" returned: 0 in 0.496s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:58 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:58 devstack sudo[88902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb
Apr 21 02:31:58 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:59 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-17fc5133-f844-415e-8f76-d5f668f454eb" returned: 0 in 0.403s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-17fc5133-f844-415e-8f76-d5f668f454eb" released by "delete_volume" :: held 0.920s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Created reservations ['2a382353-7790-479c-90af-2febb325035f', 'ce0b10de-bebc-4bdd-ae9c-02e4db0778f8', 'f8430725-3b85-40c4-abf8-c6fba0e71f37', '01c171e0-0436-4108-8d52-37510ed43c65'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:59 devstack sudo[88905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:31:59 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-f2ffe107-f614-4b94-b70a-247cc27679c0-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-f2ffe107-f614-4b94-b70a-247cc27679c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-e9704371-fadd-4e0d-bfd9-1449aea520b6" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-e9704371-fadd-4e0d-bfd9-1449aea520b6" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-f2ffe107-f614-4b94-b70a-247cc27679c0" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-f2ffe107-f614-4b94-b70a-247cc27679c0" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Deleting offline snapshot f2ffe107-f614-4b94-b70a-247cc27679c0 of volume e9704371-fadd-4e0d-bfd9-1449aea520b6 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] snapshot_file for this snap is: volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5452e1-d9e9-4862-acf0-5f16dee1c762]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:31:59 devstack sudo[88907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0
Apr 21 02:31:59 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:31:59 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.456s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:31:59 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Deleted volume successfully.
Apr 21 02:31:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1ad77a43-e139-424b-ae27-0e60f8f95459 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-17fc5133-f844-415e-8f76-d5f668f454eb-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Acquiring lock "cinder-ea608bfe-4810-4452-8284-5cb9c343a07c-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Lock "cinder-ea608bfe-4810-4452-8284-5cb9c343a07c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Acquiring lock "cinder-quobyte-ea608bfe-4810-4452-8284-5cb9c343a07c" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Lock "cinder-quobyte-ea608bfe-4810-4452-8284-5cb9c343a07c" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c775055-b9e6-4330-8a78-6b58612d15c5]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:00 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0" returned: 0 in 0.541s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9704371-fadd-4e0d-bfd9-1449aea520b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fa994e-4b2b-4384-a6f5-192b0e5a3866]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:00 devstack sudo[88913]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c
Apr 21 02:32:00 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:00 devstack sudo[88914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6
Apr 21 02:32:00 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:00 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c" returned: 0 in 0.486s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:00 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c
Apr 21 02:32:00 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:00 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6" returned: 0 in 0.477s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:00 devstack sudo[88925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0
Apr 21 02:32:00 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:00 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ea608bfe-4810-4452-8284-5cb9c343a07c" returned: 0 in 0.429s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Lock "cinder-quobyte-ea608bfe-4810-4452-8284-5cb9c343a07c" released by "delete_volume" :: held 0.936s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:01 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0" returned: 0 in 0.443s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Created reservations ['8e302fd1-f9c2-480d-a4a2-68dd7232f2d2', 'ace5abd6-ccf6-4c34-9769-1533c6e771d9', '3c361c19-3c72-46fb-be49-8019e5a4e638', '2662abb8-fb88-4b3d-bc22-a0b3fa59d3cc'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:01 devstack sudo[88931]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0
Apr 21 02:32:01 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:01 devstack sudo[88933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:01 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:01 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6.f2ffe107-f614-4b94-b70a-247cc27679c0" returned: 0 in 0.526s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-f2ffe107-f614-4b94-b70a-247cc27679c0" released by "_delete_snapshot" :: held 2.049s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-e9704371-fadd-4e0d-bfd9-1449aea520b6" released by "delete_snapshot" :: held 2.060s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:01 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.530s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:01 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Deleted volume successfully.
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Created reservations ['874c5086-5483-4f5d-b14e-00667db5db70', 'acc582b5-23db-4faf-b3f7-cadf5c4ba376', '1f41920e-e1c0-4707-bfcc-e76b3e7e3d12', 'cf63ade8-7358-4d5c-b3a7-91a553fad9c8'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5205d53c-e388-47a8-a7d9-d85df4098fc7 tempest-VolumesTransfersV355Test-596678675 None] Lock "cinder-ea608bfe-4810-4452-8284-5cb9c343a07c-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:01 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Delete snapshot completed successfully.
Apr 21 02:32:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9bb21a9d-addc-4956-8e56-8d0b320b3358 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-f2ffe107-f614-4b94-b70a-247cc27679c0-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de969b7-244c-449e-864d-bbd6967c978d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:02 devstack sudo[88938]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3
Apr 21 02:32:02 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-e9704371-fadd-4e0d-bfd9-1449aea520b6-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-e9704371-fadd-4e0d-bfd9-1449aea520b6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-e9704371-fadd-4e0d-bfd9-1449aea520b6" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-e9704371-fadd-4e0d-bfd9-1449aea520b6" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcba438-dc97-43f9-83f0-4bd8020f7998]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:02 devstack sudo[88940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6
Apr 21 02:32:02 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG oslo_service.periodic_task [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82686) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:02 devstack sudo[88942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:02 devstack sudo[88942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:03 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" returned: 0 in 0.606s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8871f732-e535-4d29-959f-0158cb434c77]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:03 devstack sudo[88947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3
Apr 21 02:32:03 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:03 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6" returned: 0 in 0.581s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:03 devstack sudo[88953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6
Apr 21 02:32:03 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:03 devstack sudo[88942]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.487s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:03 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" returned: 0 in 0.552s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.c61f50b4-c9ed-4a62-a86f-142b8cca78bam9hhrjxo.img {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:03 devstack sudo[88958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.c61f50b4-c9ed-4a62-a86f-142b8cca78bam9hhrjxo.img
Apr 21 02:32:03 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:03 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e9704371-fadd-4e0d-bfd9-1449aea520b6" returned: 0 in 0.477s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-e9704371-fadd-4e0d-bfd9-1449aea520b6" released by "delete_volume" :: held 1.086s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Created reservations ['a2973a0d-9c27-46ec-bd9a-5034d030c085', '93962e51-4d23-4cb0-b0e7-42afd9913288', '86318fe0-20de-42cd-b738-d824295dbf18', '931795fc-6221-4e87-b2de-2e382203c641'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:03 devstack sudo[88961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:03 devstack sudo[88961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:04 devstack sudo[88961]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.986s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:04 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:04 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Deleted volume successfully.
Apr 21 02:32:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4b2be2fd-093e-4938-9bd3-d6294789918c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-e9704371-fadd-4e0d-bfd9-1449aea520b6-delete_volume" released by "delete_volume" :: held 2.241s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Flow 'volume_create_manager' (fb0f4cf4-0ec6-496a-a1bd-32f12b35db62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8bf5ef-bd7d-421f-a9b7-e6203f5146e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd8bf5ef-bd7d-421f-a9b7-e6203f5146e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2096179360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968a6e72-33be-417d-9f37-41024c63bb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b828c66244f446eb76014b3acfad257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:06Z,use_quota=True,user_id='7b092e5fb4f449b8a8c37c3bd0d58c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cf9da3-e4e4-477a-8b18-4fa9371d2666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6cf9da3-e4e4-477a-8b18-4fa9371d2666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f29b08a-3164-4810-8408-dc710ba8622c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f29b08a-3164-4810-8408-dc710ba8622c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '968a6e72-33be-417d-9f37-41024c63bb1e', 'volume_name': 'volume-968a6e72-33be-417d-9f37-41024c63bb1e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f63d38-b4b1-45b5-8b8e-b53096a29520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5f63d38-b4b1-45b5-8b8e-b53096a29520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e039ee-bd21-4428-b7cf-635ac89fa963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:05 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Volume 968a6e72-33be-417d-9f37-41024c63bb1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-968a6e72-33be-417d-9f37-41024c63bb1e', 'volume_size': 1}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (d66a3cb0-f657-45ce-9fd6-b21557951141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd7c616-0304-473a-b563-b09ebd5d5472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dd7c616-0304-473a-b563-b09ebd5d5472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1457743520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897154cf-050a-41be-b6e6-24975cc00242,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:06Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbb22e4-52cc-4e9c-97cb-0b6a45f5319a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdbb22e4-52cc-4e9c-97cb-0b6a45f5319a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5e5ce5-440b-4750-843e-7cd9bbe4d336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5e5ce5-440b-4750-843e-7cd9bbe4d336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897154cf-050a-41be-b6e6-24975cc00242', 'volume_name': 'volume-897154cf-050a-41be-b6e6-24975cc00242', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800311a8-5e51-4f6a-b450-98e6aa9abe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800311a8-5e51-4f6a-b450-98e6aa9abe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:05 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d93f428-5c90-488d-ac40-31b9310ff77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:05 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Volume 897154cf-050a-41be-b6e6-24975cc00242: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897154cf-050a-41be-b6e6-24975cc00242', 'volume_size': 1}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.c61f50b4-c9ed-4a62-a86f-142b8cca78bam9hhrjxo.img" returned: 0 in 2.181s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[2820b6a4-1a0f-4275-b427-2aae320d5073]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:05 devstack sudo[88976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3
Apr 21 02:32:05 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:06 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" returned: 0 in 0.588s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:06 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.c61f50b4-c9ed-4a62-a86f-142b8cca78bam9hhrjxo.img {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:32:06 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] Converted 1024.00 MB image at 469.42 MB/s
Apr 21 02:32:06 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] c61f50b4-c9ed-4a62-a86f-142b8cca78ba was raw, no need to convert to raw {{(pid=82686) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}}
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.077s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] Uploaded volume to glance image-id: c61f50b4-c9ed-4a62-a86f-142b8cca78ba. {{(pid=82686) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.795s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2096179360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=968a6e72-33be-417d-9f37-41024c63bb1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b828c66244f446eb76014b3acfad257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:06Z,use_quota=True,user_id='7b092e5fb4f449b8a8c37c3bd0d58c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Creating volume 968a6e72-33be-417d-9f37-41024c63bb1e {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:15 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:15 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1c0ec2ff-2ada-4357-bfbc-8141b1bcf50e tempest-VolumesActionsTest-371563670 None] Copy volume to image completed successfully.
Apr 21 02:32:15 devstack sudo[88984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e 1073741824
Apr 21 02:32:15 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:15 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:UPDATE=136,cinder:DELETE=11,cinder:SELECT=107,cinder:INSERT=22 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:32:16 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e 1073741824" returned: 0 in 0.507s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:16 devstack sudo[88989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e
Apr 21 02:32:16 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:16 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e" returned: 0 in 0.445s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.716s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1457743520',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=897154cf-050a-41be-b6e6-24975cc00242,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:06Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Creating volume 897154cf-050a-41be-b6e6-24975cc00242 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:16 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43e039ee-bd21-4428-b7cf-635ac89fa963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-968a6e72-33be-417d-9f37-41024c63bb1e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:16 devstack sudo[88992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242 1073741824
Apr 21 02:32:16 devstack sudo[88992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e6b47a-0c69-4b90-8575-97489f13db1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:16 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Volume volume-968a6e72-33be-417d-9f37-41024c63bb1e (968a6e72-33be-417d-9f37-41024c63bb1e): created successfully
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23e6b47a-0c69-4b90-8575-97489f13db1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Flow 'volume_create_manager' (fb0f4cf4-0ec6-496a-a1bd-32f12b35db62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:16 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f5fe60f7-e949-4f43-b474-d444da6336b2 tempest-VolumesSnapshotTestJSON-171365862 None] Created volume successfully.
Apr 21 02:32:17 devstack sudo[88992]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242 1073741824" returned: 0 in 0.459s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:17 devstack sudo[88997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242
Apr 21 02:32:17 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:17 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242" returned: 0 in 0.418s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.040s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d93f428-5c90-488d-ac40-31b9310ff77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897154cf-050a-41be-b6e6-24975cc00242', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab577f81-8e07-43bb-ae7c-a4d9b1a8cde7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d73965-7875-47ce-91ff-986ddb1c1778]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:17 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Volume volume-897154cf-050a-41be-b6e6-24975cc00242 (897154cf-050a-41be-b6e6-24975cc00242): created successfully
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab577f81-8e07-43bb-ae7c-a4d9b1a8cde7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (d66a3cb0-f657-45ce-9fd6-b21557951141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:17 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d97bc6a5-3f7f-4f5c-bb99-c020adc3b374 tempest-VolumesGetTest-1387231622 None] Created volume successfully.
Apr 21 02:32:17 devstack sudo[89000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3
Apr 21 02:32:17 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:17 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" returned: 0 in 0.453s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba80c399-ea4d-46d6-8fbf-40062ac895b4]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:17 devstack sudo[89005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3
Apr 21 02:32:17 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:18 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" returned: 0 in 0.459s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:18 devstack sudo[89010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img
Apr 21 02:32:18 devstack sudo[89010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (9a04ceec-0dd7-423d-b3e8-1012f8eaa584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786936d4-c953-41fb-8f1d-bb868725df3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (786936d4-c953-41fb-8f1d-bb868725df3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1109292762',display_name='tempest-VolumesGetTest-Volume-1466725969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e12ae9b-78ca-4e99-9446-03c797ad6ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:19Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab455859-44d2-4f94-b505-19d9c902b79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab455859-44d2-4f94-b505-19d9c902b79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a4cc1d-9768-4f26-9f3b-2c50f988177c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60a4cc1d-9768-4f26-9f3b-2c50f988177c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e12ae9b-78ca-4e99-9446-03c797ad6ae6', 'volume_name': 'volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2585fb-1e1c-4ded-83b0-f4bb5b0ed071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2585fb-1e1c-4ded-83b0-f4bb5b0ed071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e182ad06-9349-42a1-8c80-10ce1f32f534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:18 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Volume 3e12ae9b-78ca-4e99-9446-03c797ad6ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6', 'volume_size': 1}
Apr 21 02:32:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:20 devstack sudo[89010]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img" returned: 0 in 1.887s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:20 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf83490-bb3a-49d1-812e-1bf858029d12]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:20 devstack sudo[89022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3
Apr 21 02:32:20 devstack sudo[89022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:20 devstack sudo[89022]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" returned: 0 in 0.598s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:20 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3, size 1024.00 MB, duration 1.89 sec, destination /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:32:20 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Converted 1024.00 MB image at 542.36 MB/s
Apr 21 02:32:20 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] 0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b0 was raw, converting to qcow2 {{(pid=82686) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}}
Apr 21 02:32:20 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8faec9-bc3c-4344-a96b-9eca78efedc7]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:20 devstack sudo[89027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img
Apr 21 02:32:20 devstack sudo[89027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:21 devstack sudo[89027]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img" returned: 0 in 0.481s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:21 devstack sudo[89032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img
Apr 21 02:32:21 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:21 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img" returned: 1 in 0.452s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:32:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img /opt/stack/data/cinder/conversion/vol_upload_c8qn6ts8 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:21 devstack sudo[89037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img /opt/stack/data/cinder/conversion/vol_upload_c8qn6ts8
Apr 21 02:32:21 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:22 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img /opt/stack/data/cinder/conversion/vol_upload_c8qn6ts8" returned: 0 in 0.430s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:22 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Image conversion details: src /opt/stack/data/cinder/conversion/44911e6a-2d25-431a-a29e-8d1f75bd5bc3.temp_image.0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b085e1o1ic.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_c8qn6ts8 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:32:22 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Converted 1024.00 MB image at 1024.00 MB/s
Apr 21 02:32:22 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b4d75e-ea4d-4f69-92a2-e13248661978]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c8qn6ts8 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:22 devstack sudo[89042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c8qn6ts8
Apr 21 02:32:22 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:22 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_c8qn6ts8" returned: 0 in 0.452s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.054s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Uploaded volume to glance image-id: 0d95044d-f91a-4c6c-a65c-1ef7ee9ae7b0. {{(pid=82686) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Apr 21 02:32:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.295s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] Creating offline snapshot 9ffed073-b728-492d-9c07-caa6bd68e0b9 of volume 968a6e72-33be-417d-9f37-41024c63bb1e {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:32:23 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d05c7dd1-b89e-4339-a7b5-9c60d17c90dd tempest-VolumesActionsTest-371563670 None] Copy volume to image completed successfully.
Apr 21 02:32:23 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[680a1cf0-1805-4807-94ba-8f3c84dfcdf7]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:23 devstack sudo[89047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e
Apr 21 02:32:23 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Acquiring lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Acquiring lock "cinder-quobyte-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Lock "cinder-quobyte-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55c5221-15a4-4fff-b93a-c6624f969a16]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:24 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e" returned: 0 in 0.553s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:24 devstack sudo[89053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9 1G
Apr 21 02:32:24 devstack sudo[89053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:24 devstack sudo[89052]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3
Apr 21 02:32:24 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:24 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" returned: 0 in 0.477s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:24 devstack sudo[89062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3
Apr 21 02:32:24 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:24 devstack sudo[89053]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9 1G" returned: 0 in 0.485s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968a6e72-33be-417d-9f37-41024c63bb1e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:24 devstack sudo[89064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968a6e72-33be-417d-9f37-41024c63bb1e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9
Apr 21 02:32:24 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:24 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" returned: 0 in 0.403s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Lock "cinder-quobyte-44911e6a-2d25-431a-a29e-8d1f75bd5bc3" released by "delete_volume" :: held 0.900s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:24 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Created reservations ['c9fadb3b-c0a4-4fbb-8aaf-85e36ac452dc', '1152eb0a-9cc3-4252-8d6c-0a33e062589d', 'bb4665a4-fd17-4cb6-841b-cfcfe29f7e2e', 'a6e5d057-df5f-450d-b7e4-4f9c655e162e'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:25 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-968a6e72-33be-417d-9f37-41024c63bb1e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9" returned: 0 in 0.429s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:25 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9 is being set with open permissions: ugo+rw
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:25 devstack sudo[89070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9
Apr 21 02:32:25 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:25 devstack sudo[89072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:25 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:25 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9" returned: 0 in 0.411s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:25 devstack sudo[89076]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.info
Apr 21 02:32:25 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:25 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.435s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:25 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Deleted volume successfully.
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bb5a1e4e-4f43-477c-b503-0109f4b8ead6 tempest-VolumesActionsTest-371563670 None] Lock "cinder-44911e6a-2d25-431a-a29e-8d1f75bd5bc3-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:25 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.info" returned: 0 in 0.422s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:25 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.info is being set with open permissions: ugo+rw
Apr 21 02:32:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:25 devstack sudo[89079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.info
Apr 21 02:32:25 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:26 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.info" returned: 0 in 0.467s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.832s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.598s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:19Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1109292762',display_name='tempest-VolumesGetTest-Volume-1466725969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e12ae9b-78ca-4e99-9446-03c797ad6ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:19Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Creating volume 3e12ae9b-78ca-4e99-9446-03c797ad6ae6 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:26 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:26 devstack sudo[89082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6 1073741824
Apr 21 02:32:26 devstack sudo[89082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:26 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-824e0953-3326-424b-b070-b9544f25ec24 tempest-VolumesSnapshotTestJSON-171365862 None] Create snapshot completed successfully
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Flow 'volume_create_manager' (4c439d51-aace-4e15-a107-4320c3afc8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e5f8c6-77a3-476d-ae11-5ffafd61d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2e5f8c6-77a3-476d-ae11-5ffafd61d998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1941174187',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be603b2-13ec-4357-90ed-4a1a3facdb0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b828c66244f446eb76014b3acfad257',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9ffed073-b728-492d-9c07-caa6bd68e0b9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:27Z,use_quota=True,user_id='7b092e5fb4f449b8a8c37c3bd0d58c64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2ca4db-623f-4230-bc31-b0452cfd0be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f2ca4db-623f-4230-bc31-b0452cfd0be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc585bf7-fd36-413f-ad86-57cde32fef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc585bf7-fd36-413f-ad86-57cde32fef1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9be603b2-13ec-4357-90ed-4a1a3facdb0a', 'volume_name': 'volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a', 'volume_size': 1, 'snapshot_id': '9ffed073-b728-492d-9c07-caa6bd68e0b9'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47794a2e-0964-4f37-89d4-fafebadf0d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47794a2e-0964-4f37-89d4-fafebadf0d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db040a3c-f9b4-4506-9a34-7818b1c2c54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:26 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Volume 9be603b2-13ec-4357-90ed-4a1a3facdb0a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a', 'volume_size': 1, 'snapshot_id': '9ffed073-b728-492d-9c07-caa6bd68e0b9'}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:26 devstack sudo[89082]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6 1073741824" returned: 0 in 0.575s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:26 devstack sudo[89088]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6
Apr 21 02:32:26 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:27 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6" returned: 0 in 0.461s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.491s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-9ffed073-b728-492d-9c07-caa6bd68e0b9-9be603b2-13ec-4357-90ed-4a1a3facdb0a" by "_create_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e182ad06-9349-42a1-8c80-10ce1f32f534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b524e4-58ab-41de-9696-9f1f523672d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-9ffed073-b728-492d-9c07-caa6bd68e0b9-9be603b2-13ec-4357-90ed-4a1a3facdb0a" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Creating volume 9be603b2-13ec-4357-90ed-4a1a3facdb0a from snapshot 9ffed073-b728-492d-9c07-caa6bd68e0b9 {{(pid=82686) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-9be603b2-13ec-4357-90ed-4a1a3facdb0a" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:27 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Volume volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6 (3e12ae9b-78ca-4e99-9446-03c797ad6ae6): created successfully
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85b524e4-58ab-41de-9696-9f1f523672d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (9a04ceec-0dd7-423d-b3e8-1012f8eaa584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:27 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-5ee58b9a-1717-4147-9598-9a442baf74ba tempest-VolumesGetTest-1387231622 None] Created volume successfully.
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-9be603b2-13ec-4357-90ed-4a1a3facdb0a" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] snapshot: 9ffed073-b728-492d-9c07-caa6bd68e0b9, volume: 9be603b2-13ec-4357-90ed-4a1a3facdb0a,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[328deb43-f2c6-4eac-9211-e82838a8c950]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:27 devstack sudo[89091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9
Apr 21 02:32:27 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:28 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9" returned: 0 in 0.536s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-968a6e72-33be-417d-9f37-41024c63bb1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb368cd-ff5a-49ad-8768-e126f5408be2]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:28 devstack sudo[89097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e
Apr 21 02:32:28 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-3e12ae9b-78ca-4e99-9446-03c797ad6ae6-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Lock "cinder-3e12ae9b-78ca-4e99-9446-03c797ad6ae6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-quobyte-3e12ae9b-78ca-4e99-9446-03c797ad6ae6" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-3e12ae9b-78ca-4e99-9446-03c797ad6ae6" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[70097306-6ce7-4e22-8a79-4d2988e16d7f]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:28 devstack sudo[89099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6
Apr 21 02:32:28 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:28 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e" returned: 0 in 0.593s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:32:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:28 devstack sudo[89104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a
Apr 21 02:32:28 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:29 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6" returned: 0 in 0.593s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:29 devstack sudo[89111]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6
Apr 21 02:32:29 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:30 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3e12ae9b-78ca-4e99-9446-03c797ad6ae6" returned: 0 in 1.012s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-3e12ae9b-78ca-4e99-9446-03c797ad6ae6" released by "delete_volume" :: held 1.640s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Created reservations ['06eb6d07-66d6-49ed-9b3d-ee167fe6c4e6', '7407eee0-6b21-41ad-87db-c8a243d9893a', '42359ffa-2f16-468f-96e4-039d3cbfd557', 'f86a67fe-0180-4e6f-bf34-7769a9c776ca'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:30 devstack sudo[89122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:30 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Flow 'volume_create_manager' (d238ca74-1abd-4930-9fa6-1fe7ff48be2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983b18a4-bbc4-4870-97e1-e2fc74cd2a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (983b18a4-bbc4-4870-97e1-e2fc74cd2a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-531725173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c39264e-2060-4182-9b74-1164b4cb2ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6bf8370faf4656988d56e237118f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:30Z,use_quota=True,user_id='053960247e30459db93e8c10cb5124e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ffbf5a-b3e9-4b9e-b807-249998f73ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ffbf5a-b3e9-4b9e-b807-249998f73ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013230f9-51a9-42b6-bb5a-d476d3d761d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.image.glance [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Creating Keystone auth plugin from conf {{(pid=82686) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-897154cf-050a-41be-b6e6-24975cc00242-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (013230f9-51a9-42b6-bb5a-d476d3d761d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c39264e-2060-4182-9b74-1164b4cb2ca4', 'volume_name': 'volume-2c39264e-2060-4182-9b74-1164b4cb2ca4', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bd2868b50>}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090f02e2-4c34-4b0c-8875-4b6cc0871a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (090f02e2-4c34-4b0c-8875-4b6cc0871a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97385eba-7bff-4f73-bb95-aa0711f0e335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:31 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Volume 2c39264e-2060-4182-9b74-1164b4cb2ca4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c39264e-2060-4182-9b74-1164b4cb2ca4', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bd2868b50>}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Trying to clone 2c39264e-2060-4182-9b74-1164b4cb2ca4 from image a37d0fba-01d8-4cd2-930f-61c0be29507e at location (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]). {{(pid=82686) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Lock "cinder-897154cf-050a-41be-b6e6-24975cc00242-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-quobyte-897154cf-050a-41be-b6e6-24975cc00242" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-897154cf-050a-41be-b6e6-24975cc00242" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[15efa830-65b5-40cc-a71b-774e40987b06]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:31 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a" returned: 0 in 2.531s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[82271e1f-c99e-4b14-81f8-fd7e1a3f347b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:31 devstack sudo[89124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242
Apr 21 02:32:31 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:31 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 21 02:32:31 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Image download 20.69 MB at 20.69 MB/s
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.825s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:31 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Deleted volume successfully.
Apr 21 02:32:31 devstack sudo[89127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e
Apr 21 02:32:31 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5ea7af81-6e6d-44e5-98fe-acdaf5d1aa5d tempest-VolumesGetTest-1387231622 None] Lock "cinder-3e12ae9b-78ca-4e99-9446-03c797ad6ae6-delete_volume" released by "delete_volume" :: held 2.942s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[279511cd-b928-49e8-b95b-4e006f8426fe]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:31 devstack sudo[89131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD
Apr 21 02:32:31 devstack sudo[89131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:31 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242" returned: 0 in 0.527s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:31 devstack sudo[89138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242
Apr 21 02:32:31 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:31 devstack sudo[89131]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD" returned: 0 in 0.460s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Temporary image a37d0fba-01d8-4cd2-930f-61c0be29507e is fetched for user 053960247e30459db93e8c10cb5124e9. {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[26613b14-4a76-446a-a741-c0d5747f8995]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:31 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e" returned: 0 in 0.678s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e, size 1024.00 MB, duration 2.54 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:32:31 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Converted 1024.00 MB image at 403.86 MB/s
Apr 21 02:32:31 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a is being set with open permissions: ugo+rw
Apr 21 02:32:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:31 devstack sudo[89144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD
Apr 21 02:32:31 devstack sudo[89144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:31 devstack sudo[89145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a
Apr 21 02:32:31 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:32 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-897154cf-050a-41be-b6e6-24975cc00242" returned: 0 in 0.394s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-897154cf-050a-41be-b6e6-24975cc00242" released by "delete_volume" :: held 0.957s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Created reservations ['f0061012-ffbd-4e13-8f54-6adf06461662', '4be6b5c1-f540-4123-b846-66d41e4eef29', 'c95d2230-b88a-467c-94e1-7cac263ff8bc', '93169dd6-a265-4c1d-99b2-ef5731c14635'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:32 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:32 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:32 devstack sudo[89144]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD" returned: 0 in 0.450s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:32 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a" returned: 0 in 0.434s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-9be603b2-13ec-4357-90ed-4a1a3facdb0a" released by "_copy_volume_from_snapshot" :: held 4.846s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-9ffed073-b728-492d-9c07-caa6bd68e0b9-9be603b2-13ec-4357-90ed-4a1a3facdb0a" released by "_create_volume_from_snapshot" :: held 4.890s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.919s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.044s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-531725173',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c39264e-2060-4182-9b74-1164b4cb2ca4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6bf8370faf4656988d56e237118f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:30Z,use_quota=True,user_id='053960247e30459db93e8c10cb5124e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Creating volume 2c39264e-2060-4182-9b74-1164b4cb2ca4 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:32 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:32 devstack sudo[89155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 1073741824
Apr 21 02:32:32 devstack sudo[89155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db040a3c-f9b4-4506-9a34-7818b1c2c54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a', 'volume_size': 1, 'snapshot_id': '9ffed073-b728-492d-9c07-caa6bd68e0b9'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bce7ead-2e39-47af-9cb8-be5d9d4e0a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:32 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Volume volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a (9be603b2-13ec-4357-90ed-4a1a3facdb0a): created successfully
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bce7ead-2e39-47af-9cb8-be5d9d4e0a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Flow 'volume_create_manager' (4c439d51-aace-4e15-a107-4320c3afc8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-4c35da10-8b63-4382-a5a1-f709b0442d5c tempest-VolumesSnapshotTestJSON-171365862 None] Created volume successfully.
Apr 21 02:32:32 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.434s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Deleted volume successfully.
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e123ad50-856a-40ba-9cd0-a8a08cd3239f tempest-VolumesGetTest-1387231622 None] Lock "cinder-897154cf-050a-41be-b6e6-24975cc00242-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:32 devstack sudo[89155]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 1073741824" returned: 0 in 0.480s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:32 devstack sudo[89161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4
Apr 21 02:32:32 devstack sudo[89161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:33 devstack sudo[89161]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4" returned: 0 in 0.396s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Attempting download of a37d0fba-01d8-4cd2-930f-61c0be29507e ((None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}])) to volume 2c39264e-2060-4182-9b74-1164b4cb2ca4. {{(pid=82686) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[614feb00-1f83-4aa4-8754-745dca4ea542]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_hk4f2x9e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-9be603b2-13ec-4357-90ed-4a1a3facdb0a-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-9be603b2-13ec-4357-90ed-4a1a3facdb0a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:33 devstack sudo[89164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_hk4f2x9e
Apr 21 02:32:33 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-9be603b2-13ec-4357-90ed-4a1a3facdb0a" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-9be603b2-13ec-4357-90ed-4a1a3facdb0a" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a171ef-ce47-4a54-bb2e-faea085eadb2]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (0c6285f5-1726-4596-97ad-d7252fe379c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2378f9-b2bd-4538-8f01-2fc113798799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2378f9-b2bd-4538-8f01-2fc113798799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1521792059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89b7c10-2002-44f5-947b-58dda64e2818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:33Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d83f5f1-d2b0-4077-9fa9-92e9444910d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d83f5f1-d2b0-4077-9fa9-92e9444910d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd77246-37c4-4f52-bdfd-8458e3be732b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd77246-37c4-4f52-bdfd-8458e3be732b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e89b7c10-2002-44f5-947b-58dda64e2818', 'volume_name': 'volume-e89b7c10-2002-44f5-947b-58dda64e2818', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2c6925-5277-4dd0-97e3-82adc8338fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa2c6925-5277-4dd0-97e3-82adc8338fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:33 devstack sudo[89166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a
Apr 21 02:32:33 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3382dac6-755d-48af-9bec-069101524608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:33 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Volume e89b7c10-2002-44f5-947b-58dda64e2818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e89b7c10-2002-44f5-947b-58dda64e2818', 'volume_size': 1}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1521792059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e89b7c10-2002-44f5-947b-58dda64e2818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:33Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Creating volume e89b7c10-2002-44f5-947b-58dda64e2818 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:33 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:33 devstack sudo[89168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 1073741824
Apr 21 02:32:33 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:33 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_hk4f2x9e" returned: 0 in 0.487s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_hk4f2x9e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:33 devstack sudo[89172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_hk4f2x9e
Apr 21 02:32:33 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:33 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a" returned: 0 in 0.518s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:33 devstack sudo[89180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a
Apr 21 02:32:33 devstack sudo[89180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:34 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 1073741824" returned: 0 in 0.480s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:34 devstack sudo[89182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818
Apr 21 02:32:34 devstack sudo[89182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:34 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_hk4f2x9e" returned: 1 in 0.488s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_hk4f2x9e' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb08b29e-bbb1-4a34-9e48-e096ee6cff86]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:34 devstack sudo[89186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD
Apr 21 02:32:34 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:34 devstack sudo[89180]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9be603b2-13ec-4357-90ed-4a1a3facdb0a" returned: 0 in 0.429s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-9be603b2-13ec-4357-90ed-4a1a3facdb0a" released by "delete_volume" :: held 0.982s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Created reservations ['829a9b3f-2190-477c-9d10-8da911192332', '003b308e-9934-46d1-9f97-23a74e5249e0', 'dbb1aae1-ba1b-4b5d-a827-c51bf42933a6', '9edbbbea-8494-49ca-a178-feb7fb08d96d'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:34 devstack sudo[89182]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818" returned: 0 in 0.454s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3382dac6-755d-48af-9bec-069101524608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e89b7c10-2002-44f5-947b-58dda64e2818', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:34 devstack sudo[89190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:34 devstack sudo[89190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa44811d-f1b3-4cb2-bb5c-34002b982f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:34 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Volume volume-e89b7c10-2002-44f5-947b-58dda64e2818 (e89b7c10-2002-44f5-947b-58dda64e2818): created successfully
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa44811d-f1b3-4cb2-bb5c-34002b982f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (0c6285f5-1726-4596-97ad-d7252fe379c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:34 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-11379a60-032b-4e9f-a2e3-9653f6358f44 tempest-VolumesGetTest-1387231622 None] Created volume successfully.
Apr 21 02:32:34 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD" returned: 0 in 0.517s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] a37d0fba-01d8-4cd2-930f-61c0be29507e was qcow2, converting to raw {{(pid=82686) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:34 devstack sudo[89195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4
Apr 21 02:32:34 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:34 devstack sudo[89190]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.429s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:34 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Deleted volume successfully.
Apr 21 02:32:34 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b0c229f4-c708-4a32-9d7c-6fbad803fed7 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-9be603b2-13ec-4357-90ed-4a1a3facdb0a-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-9ffed073-b728-492d-9c07-caa6bd68e0b9-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-9ffed073-b728-492d-9c07-caa6bd68e0b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-968a6e72-33be-417d-9f37-41024c63bb1e" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-968a6e72-33be-417d-9f37-41024c63bb1e" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-9ffed073-b728-492d-9c07-caa6bd68e0b9" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-9ffed073-b728-492d-9c07-caa6bd68e0b9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Deleting offline snapshot 9ffed073-b728-492d-9c07-caa6bd68e0b9 of volume 968a6e72-33be-417d-9f37-41024c63bb1e {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] snapshot_file for this snap is: volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[674227c0-3e20-40d8-81db-bc2d23117fc4]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:35 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4" returned: 0 in 0.901s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_35fp0d53devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:32:35 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Converted 112.00 MB image at 112.00 MB/s
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:35 devstack sudo[89212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 1G
Apr 21 02:32:35 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:35 devstack sudo[89211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9
Apr 21 02:32:35 devstack sudo[89211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (31cbabbb-73c6-486c-bcb2-a31b7ed1d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43737671-71eb-41c8-aaa8-e7eae34978ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=147,cinder:UPDATE=177,cinder:INSERT=53,cinder:DELETE=17 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43737671-71eb-41c8-aaa8-e7eae34978ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1318326420',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8748e33d-eece-4ec2-a15c-3f313612fe17,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=e89b7c10-2002-44f5-947b-58dda64e2818,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:36Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bff3100-5ab7-4497-b8a6-3649984f9f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bff3100-5ab7-4497-b8a6-3649984f9f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20d5919-21bc-4d9c-9226-930485f99af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e20d5919-21bc-4d9c-9226-930485f99af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8748e33d-eece-4ec2-a15c-3f313612fe17', 'volume_name': 'volume-8748e33d-eece-4ec2-a15c-3f313612fe17', 'volume_size': 1, 'source_volid': 'e89b7c10-2002-44f5-947b-58dda64e2818', 'source_volstatus': 'available'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36cf634-15b8-4b58-9354-bb23ee232342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36cf634-15b8-4b58-9354-bb23ee232342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b907cf-6f54-43ee-9edf-98a0b5c5589d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:35 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Volume 8748e33d-eece-4ec2-a15c-3f313612fe17: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8748e33d-eece-4ec2-a15c-3f313612fe17', 'volume_size': 1, 'source_volid': 'e89b7c10-2002-44f5-947b-58dda64e2818', 'source_volstatus': 'available'}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:35 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Cloning volume e89b7c10-2002-44f5-947b-58dda64e2818 to volume 8748e33d-eece-4ec2-a15c-3f313612fe17
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Creating offline snapshot dbf2d430-1c5a-4cbc-b615-37c7ac52778f of volume e89b7c10-2002-44f5-947b-58dda64e2818 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c9f86a-f59e-43d3-a464-54adc0462463]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:36 devstack sudo[89215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818
Apr 21 02:32:36 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:36 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:36 devstack sudo[89211]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 1G" returned: 0 in 0.475s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9" returned: 0 in 0.515s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-968a6e72-33be-417d-9f37-41024c63bb1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c996e320-b74c-4ec5-a809-153518318018]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7a77ac-e40f-4d9c-8e9a-90a988f80ab4]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:36 devstack sudo[89224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4
Apr 21 02:32:36 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:36 devstack sudo[89225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e
Apr 21 02:32:36 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:36 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818" returned: 0 in 0.476s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:36 devstack sudo[89231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f 1G
Apr 21 02:32:36 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:36 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4" returned: 0 in 0.462s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:36 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e" returned: 0 in 0.492s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:36 devstack sudo[89239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9
Apr 21 02:32:36 devstack sudo[89239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:36 devstack sudo[89238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4
Apr 21 02:32:36 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:36 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f 1G" returned: 0 in 0.517s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89b7c10-2002-44f5-947b-58dda64e2818 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:36 devstack sudo[89245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89b7c10-2002-44f5-947b-58dda64e2818 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f
Apr 21 02:32:36 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:37 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4" returned: 1 in 0.535s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Downloaded image a37d0fba-01d8-4cd2-930f-61c0be29507e ((None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}])) to volume 2c39264e-2060-4182-9b74-1164b4cb2ca4 successfully. {{(pid=82686) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Temporary image a37d0fba-01d8-4cd2-930f-61c0be29507e for user 053960247e30459db93e8c10cb5124e9 is deleted. {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Marking volume 2c39264e-2060-4182-9b74-1164b4cb2ca4 as bootable. {{(pid=82686) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Copying metadata from image a37d0fba-01d8-4cd2-930f-61c0be29507e to 2c39264e-2060-4182-9b74-1164b4cb2ca4. {{(pid=82686) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Creating volume glance metadata for volume 2c39264e-2060-4182-9b74-1164b4cb2ca4 backed by image a37d0fba-01d8-4cd2-930f-61c0be29507e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82686) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 21 02:32:37 devstack sudo[89239]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9" returned: 0 in 0.515s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:37 devstack sudo[89253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9
Apr 21 02:32:37 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97385eba-7bff-4f73-bb95-aa0711f0e335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c39264e-2060-4182-9b74-1164b4cb2ca4', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bd2868b50>}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73932767-0767-468f-8c20-411be126968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:37 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Volume volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 (2c39264e-2060-4182-9b74-1164b4cb2ca4): created successfully
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73932767-0767-468f-8c20-411be126968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Flow 'volume_create_manager' (d238ca74-1abd-4930-9fa6-1fe7ff48be2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:37 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-af613890-395b-493f-a1d3-7be16522e91c tempest-VolumesExtendTest-1067322561 None] Created volume successfully.
Apr 21 02:32:37 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e89b7c10-2002-44f5-947b-58dda64e2818 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f" returned: 0 in 0.461s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:37 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f is being set with open permissions: ugo+rw
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:37 devstack sudo[89258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f
Apr 21 02:32:37 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:37 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e.9ffed073-b728-492d-9c07-caa6bd68e0b9" returned: 0 in 0.448s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-9ffed073-b728-492d-9c07-caa6bd68e0b9" released by "_delete_snapshot" :: held 2.061s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-968a6e72-33be-417d-9f37-41024c63bb1e" released by "delete_snapshot" :: held 2.072s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Created reservations ['76d074e5-0934-4c1c-b401-eadb5dee6030', 'cf55cff7-84dd-4799-bdc8-a1a4c0d1a231', '4fa383c4-a7fe-4cf5-9c4d-0e8e82351736', 'aa75a81d-5710-408e-a4ad-3dc576d8d08f'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:37 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Delete snapshot completed successfully.
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6bd4127f-eb07-4ef1-a4d1-62780d26475a tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-9ffed073-b728-492d-9c07-caa6bd68e0b9-delete_snapshot" released by "delete_snapshot" :: held 2.153s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:37 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f" returned: 0 in 0.438s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:37 devstack sudo[89263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.info
Apr 21 02:32:37 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ed83e176-e1b6-4602-b0d1-3d175dfef50f tempest-VolumesExtendTest-1067322561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:38 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.info" returned: 0 in 0.436s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:38 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.info is being set with open permissions: ugo+rw
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:38 devstack sudo[89266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.info
Apr 21 02:32:38 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:38 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.info" returned: 0 in 0.405s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-quobyte-8748e33d-eece-4ec2-a15c-3f313612fe17" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-8748e33d-eece-4ec2-a15c-3f313612fe17" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] snapshot: dbf2d430-1c5a-4cbc-b615-37c7ac52778f, volume: 8748e33d-eece-4ec2-a15c-3f313612fe17,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef9dbda-65ca-49ac-bdbd-cd4402b86481]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:38 devstack sudo[89269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f
Apr 21 02:32:38 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-968a6e72-33be-417d-9f37-41024c63bb1e-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-968a6e72-33be-417d-9f37-41024c63bb1e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-968a6e72-33be-417d-9f37-41024c63bb1e" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-968a6e72-33be-417d-9f37-41024c63bb1e" acquired by "delete_volume" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa7b2e4-616d-4bcf-87ad-dc0113ac8ef8]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:38 devstack sudo[89271]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e
Apr 21 02:32:38 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:39 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f" returned: 0 in 0.494s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e89b7c10-2002-44f5-947b-58dda64e2818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[433b6f87-0240-4c64-acf6-375947cef473]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:39 devstack sudo[89276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818
Apr 21 02:32:39 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:39 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e" returned: 0 in 0.508s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:39 devstack sudo[89281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e
Apr 21 02:32:39 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:39 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818" returned: 0 in 0.479s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17 not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:39 devstack sudo[89286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17
Apr 21 02:32:39 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:39 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-968a6e72-33be-417d-9f37-41024c63bb1e" returned: 0 in 0.417s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-968a6e72-33be-417d-9f37-41024c63bb1e" released by "delete_volume" :: held 0.959s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Created reservations ['1c5693ba-c0aa-42fd-8083-f483cbf16afc', '5048058a-c0a9-4313-a065-9f7b0c81a357', 'fe8aaf71-17c3-4f39-a804-1c12e806dddb', '3db39a7f-fa35-4aa8-8057-300d258ea17b'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:39 devstack sudo[89289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:39 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "cinder-quobyte-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:40 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca156d6-8fa9-4059-bb33-3c357dbcc7bd]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:40 devstack sudo[89291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e
Apr 21 02:32:40 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:40 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.952s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:40 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:40 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Deleted volume successfully.
Apr 21 02:32:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f03151db-73e9-4322-99eb-531b111365b5 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-968a6e72-33be-417d-9f37-41024c63bb1e-delete_volume" released by "delete_volume" :: held 2.050s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:41 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e" returned: 0 in 1.368s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:41 devstack sudo[89312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e
Apr 21 02:32:41 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:41 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17" returned: 0 in 2.146s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:41 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[07744251-b479-4f6a-91a9-62bd11c365d5]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:41 devstack sudo[89314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818
Apr 21 02:32:41 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:41 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e" returned: 0 in 0.545s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-quobyte-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e" released by "delete_volume" :: held 1.947s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Created reservations ['051f9163-9dfa-4c15-9199-bae134d7c29e', '9b1469b4-3341-46fd-a474-14ae504a02f6', '9ba821e1-0887-4a57-ac11-6bc22de15c5e', '26aa1c98-72ba-4da6-ab88-697edd2e17f7'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:42 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:42 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:42 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.450s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:42 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Deleted volume successfully.
Apr 21 02:32:42 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818" returned: 0 in 0.640s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:32:42 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Converted 1024.00 MB image at 476.83 MB/s
Apr 21 02:32:42 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17 is being set with open permissions: ugo+rw
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-328b2ee7-740a-496c-84c6-3b503247b9e9 tempest-VolumesSnapshotTestJSON-171365862 None] Lock "cinder-064e8f5c-e910-4ccf-9ffc-c0e7a194e24e-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:42 devstack sudo[89323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17
Apr 21 02:32:42 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:42 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17" returned: 0 in 0.450s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-8748e33d-eece-4ec2-a15c-3f313612fe17" released by "_copy_volume_from_snapshot" :: held 4.268s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-quobyte-dbf2d430-1c5a-4cbc-b615-37c7ac52778f" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-dbf2d430-1c5a-4cbc-b615-37c7ac52778f" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Deleting offline snapshot dbf2d430-1c5a-4cbc-b615-37c7ac52778f of volume e89b7c10-2002-44f5-947b-58dda64e2818 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:32:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] snapshot_file for this snap is: volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:32:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37b22f9-41d2-4695-8eda-6f16c4339a3f]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:43 devstack sudo[89326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f
Apr 21 02:32:43 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:43 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f" returned: 0 in 0.527s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e89b7c10-2002-44f5-947b-58dda64e2818(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:32:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[59511857-dee1-45f3-92f0-60cb200c4c9b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:43 devstack sudo[89332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818
Apr 21 02:32:43 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:44 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818" returned: 0 in 0.516s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:44 devstack sudo[89337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f
Apr 21 02:32:44 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:44 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f" returned: 0 in 0.485s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:44 devstack sudo[89342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f
Apr 21 02:32:44 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:45 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818.dbf2d430-1c5a-4cbc-b615-37c7ac52778f" returned: 0 in 0.488s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-dbf2d430-1c5a-4cbc-b615-37c7ac52778f" released by "_delete_snapshot" :: held 2.062s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.168s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ed83e176-e1b6-4602-b0d1-3d175dfef50f tempest-VolumesExtendTest-1067322561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 7.135s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b907cf-6f54-43ee-9edf-98a0b5c5589d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8748e33d-eece-4ec2-a15c-3f313612fe17', 'volume_size': 1, 'source_volid': 'e89b7c10-2002-44f5-947b-58dda64e2818', 'source_volstatus': 'available'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adeb2c3-5143-4864-ab69-5986e432b103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:45 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Volume volume-8748e33d-eece-4ec2-a15c-3f313612fe17 (8748e33d-eece-4ec2-a15c-3f313612fe17): created successfully
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6adeb2c3-5143-4864-ab69-5986e432b103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (31cbabbb-73c6-486c-bcb2-a31b7ed1d449) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[19745b2f-d24f-4397-8a84-808de548d282]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed83e176-e1b6-4602-b0d1-3d175dfef50f tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:45 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1969e906-6277-4e94-ad2f-516c7563479e tempest-VolumesGetTest-1387231622 None] Created volume successfully.
Apr 21 02:32:45 devstack sudo[89346]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4
Apr 21 02:32:45 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:45 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed83e176-e1b6-4602-b0d1-3d175dfef50f tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4" returned: 0 in 0.572s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed83e176-e1b6-4602-b0d1-3d175dfef50f tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:45 devstack sudo[89350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4
Apr 21 02:32:45 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (ffce83fe-fe1b-496e-b9b9-6cfef1f2207d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd226b7-ffd3-4a3e-9a54-25986ecd8dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fd226b7-ffd3-4a3e-9a54-25986ecd8dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-317584310',display_name='tempest-VolumesGetTest-Volume-2072586208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d2bf7a-6ecd-4b26-82e8-d63727a583c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:46Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe782610-3f56-4939-aad8-52c470295c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe782610-3f56-4939-aad8-52c470295c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0081bb-8982-4756-9e86-baadd2934b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e0081bb-8982-4756-9e86-baadd2934b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37d2bf7a-6ecd-4b26-82e8-d63727a583c5', 'volume_name': 'volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5937b81a-9b67-43b4-b592-259691ebb19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5937b81a-9b67-43b4-b592-259691ebb19b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9c2673-3ebd-4dbb-8670-d90cff8578f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:45 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Volume 37d2bf7a-6ecd-4b26-82e8-d63727a583c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5', 'volume_size': 1}
Apr 21 02:32:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (f352d721-9687-47fc-aaf2-23b1de0d4e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84bea46d-7790-460e-b82d-41668aeaf2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84bea46d-7790-460e-b82d-41668aeaf2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1813222607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3579fb8c-ff8b-47c5-982e-2adf06999e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:46Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b94350f-7cee-4c31-993e-88ef2f93b8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b94350f-7cee-4c31-993e-88ef2f93b8f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76c2430-5c01-4312-be6c-f2e0c1a73b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d76c2430-5c01-4312-be6c-f2e0c1a73b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3579fb8c-ff8b-47c5-982e-2adf06999e1e', 'volume_name': 'volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5becd298-2655-44b0-b0ff-1d2e1ce7452b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5becd298-2655-44b0-b0ff-1d2e1ce7452b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a0e0a1-54c0-4ed0-b7d1-fa7656d79ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:46 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume 3579fb8c-ff8b-47c5-982e-2adf06999e1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e', 'volume_size': 1}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:46 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed83e176-e1b6-4602-b0d1-3d175dfef50f tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4" returned: 1 in 0.508s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed83e176-e1b6-4602-b0d1-3d175dfef50f tempest-VolumesExtendTest-1067322561 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed83e176-e1b6-4602-b0d1-3d175dfef50f tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 2G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ed83e176-e1b6-4602-b0d1-3d175dfef50f tempest-VolumesExtendTest-1067322561 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 2G" returned: 0 in 0.035s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ed83e176-e1b6-4602-b0d1-3d175dfef50f tempest-VolumesExtendTest-1067322561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.149s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.363s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:46Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-317584310',display_name='tempest-VolumesGetTest-Volume-2072586208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37d2bf7a-6ecd-4b26-82e8-d63727a583c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:46Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Creating volume 37d2bf7a-6ecd-4b26-82e8-d63727a583c5 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:46 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:46 devstack sudo[89358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5 1073741824
Apr 21 02:32:46 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:46 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ed83e176-e1b6-4602-b0d1-3d175dfef50f tempest-VolumesExtendTest-1067322561 None] Extend volume completed successfully.
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Acquiring lock "cinder-2c39264e-2060-4182-9b74-1164b4cb2ca4-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-2c39264e-2060-4182-9b74-1164b4cb2ca4-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Acquiring lock "cinder-quobyte-2c39264e-2060-4182-9b74-1164b4cb2ca4" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-quobyte-2c39264e-2060-4182-9b74-1164b4cb2ca4" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[70281e25-70e1-494a-b96b-873930212b32]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:46 devstack sudo[89363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4
Apr 21 02:32:46 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:46 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5 1073741824" returned: 0 in 0.520s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:46 devstack sudo[89365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5
Apr 21 02:32:46 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:47 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4" returned: 0 in 0.488s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:47 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5" returned: 0 in 0.417s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.130s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1813222607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3579fb8c-ff8b-47c5-982e-2adf06999e1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:46Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Creating volume 3579fb8c-ff8b-47c5-982e-2adf06999e1e {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:47 devstack sudo[89370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4
Apr 21 02:32:47 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:47 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb9c2673-3ebd-4dbb-8670-d90cff8578f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313bfc2d-e94f-415f-a859-e26865ccfd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:47 devstack sudo[89372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e 1073741824
Apr 21 02:32:47 devstack sudo[89372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:47 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Volume volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5 (37d2bf7a-6ecd-4b26-82e8-d63727a583c5): created successfully
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (313bfc2d-e94f-415f-a859-e26865ccfd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (ffce83fe-fe1b-496e-b9b9-6cfef1f2207d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:47 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-012568e6-4321-48b5-af6c-c0576d034804 tempest-VolumesGetTest-1387231622 None] Created volume successfully.
Apr 21 02:32:47 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4" returned: 1 in 0.473s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:47 devstack sudo[89380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4
Apr 21 02:32:47 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:47 devstack sudo[89372]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e 1073741824" returned: 0 in 0.497s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:47 devstack sudo[89382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e
Apr 21 02:32:47 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-37d2bf7a-6ecd-4b26-82e8-d63727a583c5-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Lock "cinder-37d2bf7a-6ecd-4b26-82e8-d63727a583c5-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-quobyte-37d2bf7a-6ecd-4b26-82e8-d63727a583c5" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:48 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-37d2bf7a-6ecd-4b26-82e8-d63727a583c5" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2c39264e-2060-4182-9b74-1164b4cb2ca4" returned: 0 in 0.465s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7431240b-4cda-4212-9ea1-0e1b43e950ee]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-quobyte-2c39264e-2060-4182-9b74-1164b4cb2ca4" released by "delete_volume" :: held 1.479s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Created reservations ['23924571-bd53-4872-ac4d-9ea05641b9ac', 'fff21103-dff3-4784-89dd-dd7f75541432', 'abb39181-bc34-42fc-a443-e39b0954514c', '6721f851-44fd-4abd-b4ec-6bc3d775bf94'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:48 devstack sudo[89385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5
Apr 21 02:32:48 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:48 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e" returned: 0 in 0.472s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:48 devstack sudo[89388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:48 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a0e0a1-54c0-4ed0-b7d1-fa7656d79ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf9b0d1-87cf-440f-b216-7d2844d3cae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:48 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e (3579fb8c-ff8b-47c5-982e-2adf06999e1e): created successfully
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf9b0d1-87cf-440f-b216-7d2844d3cae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (f352d721-9687-47fc-aaf2-23b1de0d4e30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-8045187b-84e5-4a03-bd5a-a7540c36cb8c tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created volume successfully.
Apr 21 02:32:48 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5" returned: 0 in 0.493s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:48 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.406s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Deleted volume successfully.
Apr 21 02:32:48 devstack sudo[89394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5
Apr 21 02:32:48 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-eed7c813-0519-430d-9f37-ac712ddda8b7 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-2c39264e-2060-4182-9b74-1164b4cb2ca4-delete_volume" released by "delete_volume" :: held 2.020s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:49 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37d2bf7a-6ecd-4b26-82e8-d63727a583c5" returned: 0 in 0.406s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-37d2bf7a-6ecd-4b26-82e8-d63727a583c5" released by "delete_volume" :: held 0.921s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Created reservations ['8434ac59-1680-42d7-9e30-abe32852bb91', '4ee01ebb-2256-4c80-b1de-c7ee9995829b', '823ab229-1185-45a0-9b88-04a51ac9ab53', 'd4de4f9b-1f28-4e2b-aeef-9c60a3a67a07'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:49 devstack sudo[89397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:49 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Flow 'volume_create_manager' (3c1b568e-c663-4bf5-98cf-4639eb2bcb9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc3978f-7da0-4b8f-b9cf-078e3daad3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dc3978f-7da0-4b8f-b9cf-078e3daad3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1979898848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6bf8370faf4656988d56e237118f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:49Z,use_quota=True,user_id='053960247e30459db93e8c10cb5124e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1734b8-9962-4c19-94aa-de7d84cb8a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1734b8-9962-4c19-94aa-de7d84cb8a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb99743e-7b29-4a88-b320-d14e4f163e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb99743e-7b29-4a88-b320-d14e4f163e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb', 'volume_name': 'volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824ba91a-754d-4efb-9421-445c31c7a3f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (824ba91a-754d-4efb-9421-445c31c7a3f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33da5539-c168-4d95-a79e-83633fe7ee57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:49 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Volume 8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb', 'volume_size': 1}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1979898848',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd6bf8370faf4656988d56e237118f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:49Z,use_quota=True,user_id='053960247e30459db93e8c10cb5124e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Creating volume 8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:49 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-8748e33d-eece-4ec2-a15c-3f313612fe17-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:49 devstack sudo[89399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb 1073741824
Apr 21 02:32:49 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Lock "cinder-8748e33d-eece-4ec2-a15c-3f313612fe17-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-quobyte-8748e33d-eece-4ec2-a15c-3f313612fe17" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-8748e33d-eece-4ec2-a15c-3f313612fe17" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f35e2d-c674-4cfe-b6de-dc6a6c4653c0]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:49 devstack sudo[89401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17
Apr 21 02:32:49 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:49 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.491s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:49 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Deleted volume successfully.
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cd4a9655-088a-4997-8083-e9798e279d40 tempest-VolumesGetTest-1387231622 None] Lock "cinder-37d2bf7a-6ecd-4b26-82e8-d63727a583c5-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:49 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb 1073741824" returned: 0 in 0.507s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:49 devstack sudo[89410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb
Apr 21 02:32:49 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:49 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17" returned: 0 in 0.487s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:49 devstack sudo[89412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17
Apr 21 02:32:49 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:50 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" returned: 0 in 0.403s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.866s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33da5539-c168-4d95-a79e-83633fe7ee57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb69d335-739c-4aae-aa9c-e13f72e83604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Creating offline snapshot 6ead660a-883d-4a38-b5da-46734a0f598b of volume 3579fb8c-ff8b-47c5-982e-2adf06999e1e {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:32:50 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Volume volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb (8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb): created successfully
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb69d335-739c-4aae-aa9c-e13f72e83604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Flow 'volume_create_manager' (3c1b568e-c663-4bf5-98cf-4639eb2bcb9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d086e1d-6741-4a31-808c-fb7192d8bb4c]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:50 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-96d98f53-1826-4139-86ad-cef9ed10938c tempest-VolumesExtendTest-1067322561 None] Created volume successfully.
Apr 21 02:32:50 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8748e33d-eece-4ec2-a15c-3f313612fe17" returned: 0 in 0.445s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-8748e33d-eece-4ec2-a15c-3f313612fe17" released by "delete_volume" :: held 0.955s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:50 devstack sudo[89417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e
Apr 21 02:32:50 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Created reservations ['40b3c1d9-36a7-4b4c-8eda-382d4a52f64f', '6cfe324c-576d-47e3-b7da-3851220bca61', '5f1d5e84-068b-4dc7-be71-a5c8b526606f', '2b0eed73-5a5b-492b-a314-115ba9529b9b'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:50 devstack sudo[89419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:50 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:50 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e" returned: 0 in 0.484s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:50 devstack sudo[89431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b 1G
Apr 21 02:32:50 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:50 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.418s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:50 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Deleted volume successfully.
Apr 21 02:32:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c7bcc2bb-a31a-4c8b-ae6b-76b438c5032e tempest-VolumesGetTest-1387231622 None] Lock "cinder-8748e33d-eece-4ec2-a15c-3f313612fe17-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:51 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b 1G" returned: 0 in 0.502s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:51 devstack sudo[89436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b
Apr 21 02:32:51 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-e89b7c10-2002-44f5-947b-58dda64e2818-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Lock "cinder-e89b7c10-2002-44f5-947b-58dda64e2818-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-quobyte-e89b7c10-2002-44f5-947b-58dda64e2818" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-e89b7c10-2002-44f5-947b-58dda64e2818" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e0b91a-822e-4351-b064-a0430149fc92]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:51 devstack sudo[89439]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818
Apr 21 02:32:51 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:51 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b" returned: 0 in 0.474s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:51 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b is being set with open permissions: ugo+rw
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:51 devstack sudo[89444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b
Apr 21 02:32:51 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:51 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818" returned: 0 in 0.475s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:52 devstack sudo[89449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818
Apr 21 02:32:52 devstack sudo[89449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:52 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b" returned: 0 in 0.400s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:52 devstack sudo[89452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.info
Apr 21 02:32:52 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:52 devstack sudo[89449]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-e89b7c10-2002-44f5-947b-58dda64e2818" returned: 0 in 0.434s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-e89b7c10-2002-44f5-947b-58dda64e2818" released by "delete_volume" :: held 0.954s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Created reservations ['23eaa9f2-10c5-4747-a75f-f57768b2c4b8', 'c8923393-a6f3-49b0-99c0-f373d28cb33c', 'b7c3e339-79df-47c5-a353-b1b79ccd4bb4', '3cbf17e4-9ed6-4078-93ab-17a71a78acd7'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:52 devstack sudo[89455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:32:52 devstack sudo[89455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:52 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.info" returned: 0 in 0.431s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:52 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.info is being set with open permissions: ugo+rw
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:52 devstack sudo[89458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.info
Apr 21 02:32:52 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:52 devstack sudo[89455]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (5eded58c-3b0f-4b19-bfa7-02ce7ac5507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d16b6d4-8ab8-4f17-9aa3-8c1257c50e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.489s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:52 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:32:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Deleted volume successfully.
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d16b6d4-8ab8-4f17-9aa3-8c1257c50e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-121788179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d97506d-7fb7-408a-bc71-92b8c4223923,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:53Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5481bc19-2101-42cc-9654-a4ffc51d6b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5481bc19-2101-42cc-9654-a4ffc51d6b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e502cc66-e8bc-4c04-82dd-150c0ae19939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:53 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.image.glance [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Creating Keystone auth plugin from conf {{(pid=82686) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.info" returned: 0 in 0.435s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.809s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.687s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] Creating offline snapshot d4f5294b-21c5-454a-9856-f52c653270f5 of volume 8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6ca519e4-3774-4ca9-8f9b-7ad3d61b9e31 tempest-VolumesGetTest-1387231622 None] Lock "cinder-e89b7c10-2002-44f5-947b-58dda64e2818-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[487e02db-e4d8-4b56-8a88-f79984a8e39a]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c1d286ec-29a5-4c56-983e-ed2b8f73951f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Create snapshot completed successfully
Apr 21 02:32:53 devstack sudo[89462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb
Apr 21 02:32:53 devstack sudo[89462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e502cc66-e8bc-4c04-82dd-150c0ae19939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d97506d-7fb7-408a-bc71-92b8c4223923', 'volume_name': 'volume-2d97506d-7fb7-408a-bc71-92b8c4223923', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bc7ced900>}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b72b57-1a83-454a-9a39-c64381d36d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b72b57-1a83-454a-9a39-c64381d36d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af3003d-55ad-4113-b144-3ba9e9d57c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:53 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Volume 2d97506d-7fb7-408a-bc71-92b8c4223923: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d97506d-7fb7-408a-bc71-92b8c4223923', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bc7ced900>}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Trying to clone 2d97506d-7fb7-408a-bc71-92b8c4223923 from image a37d0fba-01d8-4cd2-930f-61c0be29507e at location (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]). {{(pid=82686) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}}
Apr 21 02:32:53 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Image download 20.69 MB at 20.69 MB/s
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[1102fecf-ec27-40dc-a235-0804d5e1d945]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:53 devstack sudo[89465]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD
Apr 21 02:32:53 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:53 devstack sudo[89462]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" returned: 0 in 0.494s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:53 devstack sudo[89470]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 1G
Apr 21 02:32:53 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (31ad0ee8-1423-4dc1-a288-b39c71437771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bcb646-5b93-4a2d-86b8-741d1f789e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38bcb646-5b93-4a2d-86b8-741d1f789e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-52215350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8afb1a-97b3-432b-9aa7-9738d70879b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:54Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc939ec5-53ab-41d7-aeda-43ee59af1dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc939ec5-53ab-41d7-aeda-43ee59af1dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edab8a4-726c-45d0-8f80-2853c0675856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2edab8a4-726c-45d0-8f80-2853c0675856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8afb1a-97b3-432b-9aa7-9738d70879b6', 'volume_name': 'volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3663e825-1d44-43bd-a06e-a40ed947c1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3663e825-1d44-43bd-a06e-a40ed947c1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4907afd-8765-4dcc-86e2-cd83e8647bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:53 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume 3f8afb1a-97b3-432b-9aa7-9738d70879b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6', 'volume_size': 1}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (612d08eb-2d69-4744-bc63-7e23a2601f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2345c0-4487-45fc-a9fd-52d7e34d9e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:53 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD" returned: 0 in 0.517s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:53 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Temporary image a37d0fba-01d8-4cd2-930f-61c0be29507e is fetched for user 63f8463479ee4065bfcaa657281660d1. {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae2345c0-4487-45fc-a9fd-52d7e34d9e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1591548795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9077be6c-6507-427a-b399-e5a678ad4592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:54Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a7b66b-6a34-49d5-be07-7ef229448bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a7b66b-6a34-49d5-be07-7ef229448bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc686c6-05f4-4788-ab2f-fcb395f40688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc686c6-05f4-4788-ab2f-fcb395f40688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9077be6c-6507-427a-b399-e5a678ad4592', 'volume_name': 'volume-9077be6c-6507-427a-b399-e5a678ad4592', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16b4c1d-449d-44de-b5ea-e5d49c05b021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a16b4c1d-449d-44de-b5ea-e5d49c05b021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779c5d38-b713-4359-89ec-b7416e5fb412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume 9077be6c-6507-427a-b399-e5a678ad4592: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9077be6c-6507-427a-b399-e5a678ad4592', 'volume_size': 1}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb21005-0507-4103-913d-6367eac5df9f]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:54 devstack sudo[89478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD
Apr 21 02:32:54 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:54 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 1G" returned: 0 in 0.609s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:54 devstack sudo[89480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5
Apr 21 02:32:54 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (e9fbeaf1-bb9d-42bd-8e76-8312edddf03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e5c392-4e97-4222-826f-7c579d1f027c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1e5c392-4e97-4222-826f-7c579d1f027c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1517251483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa97a442-4f96-4fca-8a12-69958f20256d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:54Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa730cc-723a-4fee-bc33-7d7970825828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaa730cc-723a-4fee-bc33-7d7970825828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76843b17-65f0-4bcb-86ee-97b2ccd30d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76843b17-65f0-4bcb-86ee-97b2ccd30d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa97a442-4f96-4fca-8a12-69958f20256d', 'volume_name': 'volume-fa97a442-4f96-4fca-8a12-69958f20256d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fbea29-823e-4959-a313-b15d2deaa6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25fbea29-823e-4959-a313-b15d2deaa6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9886d01-efce-449c-9afb-d1b06d63e885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume fa97a442-4f96-4fca-8a12-69958f20256d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa97a442-4f96-4fca-8a12-69958f20256d', 'volume_size': 1}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (39b9fd5b-e86d-4952-96fc-32fa4f525cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dace25a9-abff-48d9-bc81-4c2d86e56673) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dace25a9-abff-48d9-bc81-4c2d86e56673) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-537208307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994e9441-8f96-4e5c-880b-04b5a03e1900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:54Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72f13af-796c-4774-9863-cb2bc71cd12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72f13af-796c-4774-9863-cb2bc71cd12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b309a554-e753-4d17-93d3-8c3fefeb8229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b309a554-e753-4d17-93d3-8c3fefeb8229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '994e9441-8f96-4e5c-880b-04b5a03e1900', 'volume_name': 'volume-994e9441-8f96-4e5c-880b-04b5a03e1900', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea502b94-64e8-41b6-93cc-d5ef5bd8bc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea502b94-64e8-41b6-93cc-d5ef5bd8bc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b880229f-9c04-428d-9b2f-cebdb8c7193d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume 994e9441-8f96-4e5c-880b-04b5a03e1900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-994e9441-8f96-4e5c-880b-04b5a03e1900', 'volume_size': 1}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (67a1a9f9-8d6a-4c7d-9d6e-7bdb332dd3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8417e71-561b-4a5b-99c3-fb3db14fbfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8417e71-561b-4a5b-99c3-fb3db14fbfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064071340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:55Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6911b8-166d-4e5e-9a91-094fa9178d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c6911b8-166d-4e5e-9a91-094fa9178d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8cf082-682e-43bc-836c-419aac984d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e8cf082-682e-43bc-836c-419aac984d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2', 'volume_name': 'volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfa7062-4dd1-457d-9b44-f0f03908f809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdfa7062-4dd1-457d-9b44-f0f03908f809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34cc720-add6-43f8-b2fc-46fa9c11a80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:54 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume 373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2', 'volume_size': 1}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD" returned: 0 in 0.581s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:54 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5" returned: 0 in 0.514s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:54 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 is being set with open permissions: ugo+rw
Apr 21 02:32:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:54 devstack sudo[89488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5
Apr 21 02:32:54 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:55 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5" returned: 0 in 0.417s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:55 devstack sudo[89491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.info
Apr 21 02:32:55 devstack sudo[89491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:55 devstack sudo[89491]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.info" returned: 0 in 0.416s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:55 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.info is being set with open permissions: ugo+rw
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:55 devstack sudo[89494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.info
Apr 21 02:32:55 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:55 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.info" returned: 0 in 0.413s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.926s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.191s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-52215350',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8afb1a-97b3-432b-9aa7-9738d70879b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:54Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Creating volume 3f8afb1a-97b3-432b-9aa7-9738d70879b6 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:56 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:56 devstack sudo[89497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6 1073741824
Apr 21 02:32:56 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:56 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-be4b9f6c-3f46-4b76-9e44-e1ca507633a2 tempest-VolumesExtendTest-1067322561 None] Create snapshot completed successfully
Apr 21 02:32:56 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6 1073741824" returned: 0 in 0.483s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:56 devstack sudo[89502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6
Apr 21 02:32:56 devstack sudo[89502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c9f72853-c38e-4b50-86e7-b2d9a6f28fa2 tempest-VolumesExtendTest-1067322561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:56 devstack sudo[89502]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6" returned: 0 in 0.431s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.897s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1591548795',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9077be6c-6507-427a-b399-e5a678ad4592,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:54Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Creating volume 9077be6c-6507-427a-b399-e5a678ad4592 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:56 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4907afd-8765-4dcc-86e2-cd83e8647bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cafeb154-6cd5-4df9-8c90-2933ccf95eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:56 devstack sudo[89505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592 1073741824
Apr 21 02:32:56 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:56 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6 (3f8afb1a-97b3-432b-9aa7-9738d70879b6): created successfully
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cafeb154-6cd5-4df9-8c90-2933ccf95eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (31ad0ee8-1423-4dc1-a288-b39c71437771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:56 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-5762c1eb-9fdb-4124-b812-9ecc2372c9a1 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created volume successfully.
Apr 21 02:32:57 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592 1073741824" returned: 0 in 0.486s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:57 devstack sudo[89510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592
Apr 21 02:32:57 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:57 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592" returned: 0 in 0.401s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.588s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1517251483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa97a442-4f96-4fca-8a12-69958f20256d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:54Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Creating volume fa97a442-4f96-4fca-8a12-69958f20256d {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:57 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (779c5d38-b713-4359-89ec-b7416e5fb412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9077be6c-6507-427a-b399-e5a678ad4592', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f44601-5a1d-4c76-a3f0-e8dabbd8ba4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:57 devstack sudo[89513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d 1073741824
Apr 21 02:32:57 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:57 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume volume-9077be6c-6507-427a-b399-e5a678ad4592 (9077be6c-6507-427a-b399-e5a678ad4592): created successfully
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09f44601-5a1d-4c76-a3f0-e8dabbd8ba4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (612d08eb-2d69-4744-bc63-7e23a2601f03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:57 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-db83cb09-d974-4452-8199-346547f23f0f tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created volume successfully.
Apr 21 02:32:58 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d 1073741824" returned: 0 in 0.482s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:58 devstack sudo[89530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d
Apr 21 02:32:58 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:58 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d" returned: 0 in 0.430s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.940s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.345s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-537208307',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=994e9441-8f96-4e5c-880b-04b5a03e1900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:54Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Creating volume 994e9441-8f96-4e5c-880b-04b5a03e1900 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:58 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9886d01-efce-449c-9afb-d1b06d63e885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa97a442-4f96-4fca-8a12-69958f20256d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd943088-b3c7-491c-966a-eff8eec20262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:58 devstack sudo[89555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900 1073741824
Apr 21 02:32:58 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:58 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume volume-fa97a442-4f96-4fca-8a12-69958f20256d (fa97a442-4f96-4fca-8a12-69958f20256d): created successfully
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd943088-b3c7-491c-966a-eff8eec20262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (e9fbeaf1-bb9d-42bd-8e76-8312edddf03f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:58 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-17580d78-a751-47c8-aca4-d5a2e336cbb9 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created volume successfully.
Apr 21 02:32:59 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900 1073741824" returned: 0 in 0.488s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:59 devstack sudo[89560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900
Apr 21 02:32:59 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:59 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900" returned: 0 in 0.395s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.073s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2064071340',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e00615cd2744cb7ac9ece2231a39f63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:55Z,use_quota=True,user_id='2ae31eb709f04f3bbf2cbf32e6934ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Creating volume 373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:32:59 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b880229f-9c04-428d-9b2f-cebdb8c7193d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-994e9441-8f96-4e5c-880b-04b5a03e1900', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:59 devstack sudo[89563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2 1073741824
Apr 21 02:32:59 devstack sudo[89563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c764eff-1008-44ca-a015-29e8a3446769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:32:59 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume volume-994e9441-8f96-4e5c-880b-04b5a03e1900 (994e9441-8f96-4e5c-880b-04b5a03e1900): created successfully
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c764eff-1008-44ca-a015-29e8a3446769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:32:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (39b9fd5b-e86d-4952-96fc-32fa4f525cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:32:59 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9228753f-96e9-4eb3-ad45-43ddd2158521 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created volume successfully.
Apr 21 02:33:00 devstack sudo[89563]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2 1073741824" returned: 0 in 0.485s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:00 devstack sudo[89568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2
Apr 21 02:33:00 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:00 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2" returned: 0 in 0.399s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.985s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-121788179',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d97506d-7fb7-408a-bc71-92b8c4223923,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:32:53Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Creating volume 2d97506d-7fb7-408a-bc71-92b8c4223923 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:00 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:00 devstack sudo[89571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 1073741824
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b34cc720-add6-43f8-b2fc-46fa9c11a80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:00 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6832f944-4f34-4d09-9d60-4c018888820e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:00 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Volume volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2 (373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2): created successfully
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6832f944-4f34-4d09-9d60-4c018888820e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Flow 'volume_create_manager' (67a1a9f9-8d6a-4c7d-9d6e-7bdb332dd3dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:00 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c5ec4805-79c9-48df-ba45-720b9c68fdcc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created volume successfully.
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-quobyte-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1ab800-6928-4af1-abd6-49968161f1b8]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:01 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 1073741824" returned: 0 in 0.511s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:01 devstack sudo[89576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2
Apr 21 02:33:01 devstack sudo[89576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:01 devstack sudo[89577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923
Apr 21 02:33:01 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:01 devstack sudo[89576]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2" returned: 0 in 0.495s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:01 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923" returned: 0 in 0.447s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:01 devstack sudo[89585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2
Apr 21 02:33:01 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c9f72853-c38e-4b50-86e7-b2d9a6f28fa2 tempest-VolumesExtendTest-1067322561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 5.056s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[490f936d-c98d-4aca-aa31-1e73e36daa94]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c9f72853-c38e-4b50-86e7-b2d9a6f28fa2 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Attempting download of a37d0fba-01d8-4cd2-930f-61c0be29507e ((None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}])) to volume 2d97506d-7fb7-408a-bc71-92b8c4223923. {{(pid=82686) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}}
Apr 21 02:33:01 devstack sudo[89587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb
Apr 21 02:33:01 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79aba8d-cda1-4303-99b8-a007b9f2945c]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_eszt839j {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:01 devstack sudo[89589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_eszt839j
Apr 21 02:33:01 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:02 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2" returned: 0 in 0.452s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2" released by "delete_volume" :: held 0.971s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created reservations ['dd43d36c-fed7-43fc-9d96-f145d4209d42', '90abb1e8-d51c-4b03-aa2d-3f46f18a514c', '0ae9a02e-f8bf-4cf8-aab0-4ab44a16ae36', '231929f5-4ed1-4eed-8082-7b8900f10cc6'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:02 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c9f72853-c38e-4b50-86e7-b2d9a6f28fa2 tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" returned: 0 in 0.480s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c9f72853-c38e-4b50-86e7-b2d9a6f28fa2 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 2G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:02 devstack sudo[89600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:02 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-994e9441-8f96-4e5c-880b-04b5a03e1900-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-994e9441-8f96-4e5c-880b-04b5a03e1900-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c9f72853-c38e-4b50-86e7-b2d9a6f28fa2 tempest-VolumesExtendTest-1067322561 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 2G" returned: 0 in 0.102s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c9f72853-c38e-4b50-86e7-b2d9a6f28fa2 tempest-VolumesExtendTest-1067322561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.603s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:02 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_eszt839j" returned: 0 in 0.527s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_eszt839j {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-quobyte-994e9441-8f96-4e5c-880b-04b5a03e1900" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:02 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c9f72853-c38e-4b50-86e7-b2d9a6f28fa2 tempest-VolumesExtendTest-1067322561 None] Extend volume completed successfully.
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-994e9441-8f96-4e5c-880b-04b5a03e1900" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4c31a0-e6b6-4014-a0e3-f7c2c37412ba]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:02 devstack sudo[89602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_eszt839j
Apr 21 02:33:02 devstack sudo[89602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:02 devstack sudo[89603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900
Apr 21 02:33:02 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:02 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.435s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:02 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Deleted volume successfully.
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d3fc925-397f-42ac-83e2-01ce33236665 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-373cf1ba-d60a-4e4e-b1cc-9b9526e9dfa2-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:02 devstack sudo[89602]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_eszt839j" returned: 1 in 0.476s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a37d0fba-01d8-4cd2-930f-61c0be29507e_eszt839j' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc53f9-cd82-4cb1-9088-604202ef9518]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:02 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900" returned: 0 in 0.485s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:02 devstack sudo[89612]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD
Apr 21 02:33:02 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:02 devstack sudo[89613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900
Apr 21 02:33:02 devstack sudo[89613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_service.periodic_task [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82686) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:02 devstack sudo[89616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:02 devstack sudo[89616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Acquiring lock "cinder-d4f5294b-21c5-454a-9856-f52c653270f5-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-d4f5294b-21c5-454a-9856-f52c653270f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Acquiring lock "cinder-quobyte-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-quobyte-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Acquiring lock "cinder-quobyte-d4f5294b-21c5-454a-9856-f52c653270f5" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-quobyte-d4f5294b-21c5-454a-9856-f52c653270f5" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Deleting offline snapshot d4f5294b-21c5-454a-9856-f52c653270f5 of volume 8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:33:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] snapshot_file for this snap is: volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e781988-f8db-458f-86b3-6e9b8b68a946]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:03 devstack sudo[89618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5
Apr 21 02:33:03 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:03 devstack sudo[89613]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:03 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD" returned: 0 in 0.506s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-994e9441-8f96-4e5c-880b-04b5a03e1900" returned: 0 in 0.451s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] a37d0fba-01d8-4cd2-930f-61c0be29507e was qcow2, converting to raw {{(pid=82686) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:03 devstack sudo[89624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923
Apr 21 02:33:03 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-994e9441-8f96-4e5c-880b-04b5a03e1900" released by "delete_volume" :: held 0.980s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created reservations ['a6bec576-4bdc-4c24-b7d1-71b77a677475', 'e2244591-d3c3-4636-b93d-c59a3b41776c', 'e8f84067-bc51-4a2e-a809-1726998d3939', '2d99e2b1-6a2a-4c31-83e5-37ede472d993'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:03 devstack sudo[89616]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.458s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:03 devstack sudo[89627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:03 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:03 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5" returned: 0 in 0.528s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fbf5909-6082-4470-9c0c-87afe387db59]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:03 devstack sudo[89632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb
Apr 21 02:33:03 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:03 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.507s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:03 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Deleted volume successfully.
Apr 21 02:33:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-7d3782ad-bf21-4270-a270-5747ef92f064 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-994e9441-8f96-4e5c-880b-04b5a03e1900-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:04 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923" returned: 0 in 0.859s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a37d0fba-01d8-4cd2-930f-61c0be29507e_n6m02uzldevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:33:04 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Converted 112.00 MB image at 112.00 MB/s
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:04 devstack sudo[89653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 1G
Apr 21 02:33:04 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:04 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" returned: 0 in 0.595s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:04 devstack sudo[89655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5
Apr 21 02:33:04 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-fa97a442-4f96-4fca-8a12-69958f20256d-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-fa97a442-4f96-4fca-8a12-69958f20256d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-quobyte-fa97a442-4f96-4fca-8a12-69958f20256d" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-fa97a442-4f96-4fca-8a12-69958f20256d" acquired by "delete_volume" :: waited 0.034s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bc85f0-263b-48ab-92ba-b00b4f1a7386]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:04 devstack sudo[89660]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d
Apr 21 02:33:04 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:04 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 1G" returned: 0 in 0.462s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f4799a-aa3d-40fc-be01-3f13933888ae]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:04 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5" returned: 0 in 0.491s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:04 devstack sudo[89666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5
Apr 21 02:33:04 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:04 devstack sudo[89665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923
Apr 21 02:33:04 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:04 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d" returned: 0 in 0.518s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:05 devstack sudo[89675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d
Apr 21 02:33:05 devstack sudo[89675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:05 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb.d4f5294b-21c5-454a-9856-f52c653270f5" returned: 0 in 0.422s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-quobyte-d4f5294b-21c5-454a-9856-f52c653270f5" released by "_delete_snapshot" :: held 2.093s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:05 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-quobyte-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" released by "delete_snapshot" :: held 2.102s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923" returned: 0 in 0.495s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Created reservations ['0c2417d2-4bd3-46da-b6e8-3550c8212e2e', 'be349698-553f-40e9-9d2c-e9d30bf1f728', '8085ba30-d0a5-4fab-acee-384163d8ebd4', 'e1639150-113a-4e70-b0bf-0f2a7c1ed0e1'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:05 devstack sudo[89677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923
Apr 21 02:33:05 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:05 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Delete snapshot completed successfully.
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-748bc8e5-a56d-4eb5-8f74-9e7dc0933ce5 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-d4f5294b-21c5-454a-9856-f52c653270f5-delete_snapshot" released by "delete_snapshot" :: held 2.191s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:05 devstack sudo[89675]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fa97a442-4f96-4fca-8a12-69958f20256d" returned: 0 in 0.415s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-fa97a442-4f96-4fca-8a12-69958f20256d" released by "delete_volume" :: held 0.955s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created reservations ['b27a4809-72be-4723-8228-7e6d0aeeee2d', '3ee94516-0376-4d9e-b7c3-25fd4a742924', '10f603e2-296f-4106-921e-4c525d335324', '49edad54-280d-4204-b0ff-ed1c75d49fc9'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:05 devstack sudo[89680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:05 devstack sudo[89680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-9077be6c-6507-427a-b399-e5a678ad4592-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-9077be6c-6507-427a-b399-e5a678ad4592-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-quobyte-9077be6c-6507-427a-b399-e5a678ad4592" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:05 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923" returned: 1 in 0.506s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Downloaded image a37d0fba-01d8-4cd2-930f-61c0be29507e ((None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}])) to volume 2d97506d-7fb7-408a-bc71-92b8c4223923 successfully. {{(pid=82686) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Temporary image a37d0fba-01d8-4cd2-930f-61c0be29507e for user 63f8463479ee4065bfcaa657281660d1 is deleted. {{(pid=82686) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.volume.volume_utils [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Marking volume 2d97506d-7fb7-408a-bc71-92b8c4223923 as bootable. {{(pid=82686) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-9077be6c-6507-427a-b399-e5a678ad4592" acquired by "delete_volume" :: waited 0.019s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Copying metadata from image a37d0fba-01d8-4cd2-930f-61c0be29507e to 2d97506d-7fb7-408a-bc71-92b8c4223923. {{(pid=82686) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Creating volume glance metadata for volume 2d97506d-7fb7-408a-bc71-92b8c4223923 backed by image a37d0fba-01d8-4cd2-930f-61c0be29507e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82686) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6504b97-d55c-4335-803d-7fb400267473]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af3003d-55ad-4113-b144-3ba9e9d57c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d97506d-7fb7-408a-bc71-92b8c4223923', 'volume_size': 1, 'image_id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a37d0fba-01d8-4cd2-930f-61c0be29507e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '94a63f75021b40fcaea52264610470bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a37d0fba-01d8-4cd2-930f-61c0be29507e', 'created_at': datetime.datetime(2026, 4, 21, 0, 21, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 21, 0, 21, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a37d0fba-01d8-4cd2-930f-61c0be29507e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3bc7ced900>}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf22bb5a-3c2f-4c7d-a7c7-7725de71466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:05 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Volume volume-2d97506d-7fb7-408a-bc71-92b8c4223923 (2d97506d-7fb7-408a-bc71-92b8c4223923): created successfully
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf22bb5a-3c2f-4c7d-a7c7-7725de71466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (5eded58c-3b0f-4b19-bfa7-02ce7ac5507d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:05 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ce6e2b89-75b5-4dab-bc55-3222f861496c tempest-VolumesGetTest-1387231622 None] Created volume successfully.
Apr 21 02:33:05 devstack sudo[89685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592
Apr 21 02:33:05 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:05 devstack sudo[89680]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.451s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:05 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Deleted volume successfully.
Apr 21 02:33:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-92038c4b-074a-445c-b550-758083533457 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-fa97a442-4f96-4fca-8a12-69958f20256d-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:06 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592" returned: 0 in 0.460s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:06 devstack sudo[89691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592
Apr 21 02:33:06 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Acquiring lock "cinder-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Acquiring lock "cinder-quobyte-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-quobyte-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" acquired by "delete_volume" :: waited 0.016s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7b2b5e-2243-4f3f-88ef-1c0b81c8a0be]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:06 devstack sudo[89693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb
Apr 21 02:33:06 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:06 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-9077be6c-6507-427a-b399-e5a678ad4592" returned: 0 in 0.405s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-9077be6c-6507-427a-b399-e5a678ad4592" released by "delete_volume" :: held 0.922s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created reservations ['19949877-cd82-43cc-8cc3-b2c1a507a49d', '84ec3789-6468-4db0-b4f1-a01b599bcebe', '8ad6b02e-af4c-421a-b9a1-e6f4e9eb4eaf', '3c0e3b9b-fcee-4512-9a9c-59c5a1b16d6b'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:06 devstack sudo[89696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:06 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-3f8afb1a-97b3-432b-9aa7-9738d70879b6-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-3f8afb1a-97b3-432b-9aa7-9738d70879b6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-quobyte-3f8afb1a-97b3-432b-9aa7-9738d70879b6" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-3f8afb1a-97b3-432b-9aa7-9738d70879b6" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[56691ce5-2b9f-4973-a3e6-afe5e0d0b70e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:06 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" returned: 0 in 0.596s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:06 devstack sudo[89702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb
Apr 21 02:33:06 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:06 devstack sudo[89701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6
Apr 21 02:33:06 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:07 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.518s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (5583a0fb-bd7d-4110-9ac7-0c562c1d161c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b041e5f2-f6c3-4c86-b048-6dd8bfc16ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:07 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Deleted volume successfully.
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b041e5f2-f6c3-4c86-b048-6dd8bfc16ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-875622344',display_name='tempest-VolumesGetTest-Volume-1487107711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96264e4-fa45-4952-bb77-ca0f5cf571e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:07Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70db5db0-1b1b-49f9-a3aa-b92b28ff9f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70db5db0-1b1b-49f9-a3aa-b92b28ff9f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30b216a-9479-4d1a-81e3-347094e49e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b30b216a-9479-4d1a-81e3-347094e49e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a96264e4-fa45-4952-bb77-ca0f5cf571e3', 'volume_name': 'volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83320d9b-5a3b-403b-8bb4-bebdc4150f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83320d9b-5a3b-403b-8bb4-bebdc4150f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5d8654-c378-4833-95a1-97b119d5ff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:07 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Volume a96264e4-fa45-4952-bb77-ca0f5cf571e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3', 'volume_size': 1}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-875622344',display_name='tempest-VolumesGetTest-Volume-1487107711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a96264e4-fa45-4952-bb77-ca0f5cf571e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a87725357ad4a338a5445ce3939d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:07Z,use_quota=True,user_id='63f8463479ee4065bfcaa657281660d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Creating volume a96264e4-fa45-4952-bb77-ca0f5cf571e3 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:07 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-df5b418e-1732-49c6-9db4-6d499a151034 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-9077be6c-6507-427a-b399-e5a678ad4592-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:07 devstack sudo[89707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3 1073741824
Apr 21 02:33:07 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:07 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" returned: 0 in 0.426s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-quobyte-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb" released by "delete_volume" :: held 1.050s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Created reservations ['1e5881a2-395d-44bc-ad97-d16c9340fb04', 'b1a866f7-2715-4e65-b813-4e514995e420', '6e4a3b3b-baf3-4b5d-be45-fcfd5f5a360d', 'd80f12ba-1bbe-42d8-81ea-1b4233e51c6e'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:07 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:07 devstack sudo[89712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6" returned: 0 in 0.572s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:07 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:07 devstack sudo[89714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6
Apr 21 02:33:07 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:07 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3 1073741824" returned: 0 in 0.521s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:07 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.424s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:07 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Deleted volume successfully.
Apr 21 02:33:07 devstack sudo[89721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-719284ca-6a1e-4b03-8c7c-d9768867b399 tempest-VolumesExtendTest-1067322561 None] Lock "cinder-8162dd74-b7cf-4aad-a396-0cdb1ed8b0bb-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:07 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:07 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3f8afb1a-97b3-432b-9aa7-9738d70879b6" returned: 0 in 0.446s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-3f8afb1a-97b3-432b-9aa7-9738d70879b6" released by "delete_volume" :: held 1.043s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created reservations ['8cf2d373-2916-4a71-baa3-1287512a2ea6', '11f317f4-4782-442b-aa68-8c18ac14c05b', 'cf870456-c474-45e9-a2f1-d7d51693dc9c', 'e7402467-8305-4045-a426-abdf2c100dae'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:07 devstack sudo[89723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:07 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:08 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3" returned: 0 in 0.433s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb5d8654-c378-4833-95a1-97b119d5ff9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d38698-11b8-4453-9d8c-c10195344b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:08 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Volume volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3 (a96264e4-fa45-4952-bb77-ca0f5cf571e3): created successfully
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9d38698-11b8-4453-9d8c-c10195344b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Flow 'volume_create_manager' (5583a0fb-bd7d-4110-9ac7-0c562c1d161c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:08 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-de7a46a9-8b3e-4400-986c-5e362eaf8249 tempest-VolumesGetTest-1387231622 None] Created volume successfully.
Apr 21 02:33:08 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.424s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:08 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Deleted volume successfully.
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9056a8d7-6c9e-455f-9945-08b1d659fb1b tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-3f8afb1a-97b3-432b-9aa7-9738d70879b6-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-6ead660a-883d-4a38-b5da-46734a0f598b-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-6ead660a-883d-4a38-b5da-46734a0f598b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-quobyte-3579fb8c-ff8b-47c5-982e-2adf06999e1e" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-3579fb8c-ff8b-47c5-982e-2adf06999e1e" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-quobyte-6ead660a-883d-4a38-b5da-46734a0f598b" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-6ead660a-883d-4a38-b5da-46734a0f598b" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Deleting offline snapshot 6ead660a-883d-4a38-b5da-46734a0f598b of volume 3579fb8c-ff8b-47c5-982e-2adf06999e1e {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] snapshot_file for this snap is: volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[3726cc80-d2c4-42fe-8c91-9514ad44e7e0]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:09 devstack sudo[89728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b
Apr 21 02:33:09 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-a96264e4-fa45-4952-bb77-ca0f5cf571e3-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Lock "cinder-a96264e4-fa45-4952-bb77-ca0f5cf571e3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-quobyte-a96264e4-fa45-4952-bb77-ca0f5cf571e3" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-a96264e4-fa45-4952-bb77-ca0f5cf571e3" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9050f3f0-fa0f-46b4-a78d-4469525ac502]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:09 devstack sudo[89733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3
Apr 21 02:33:09 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:09 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b" returned: 0 in 0.586s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e9fe17-4818-45da-89d9-a9ab35444f26]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:09 devstack sudo[89735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e
Apr 21 02:33:09 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:09 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3" returned: 0 in 0.520s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:09 devstack sudo[89742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3
Apr 21 02:33:09 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:10 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e" returned: 0 in 0.511s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:10 devstack sudo[89745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b
Apr 21 02:33:10 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Flow 'volume_create_manager' (79d849ed-121f-4b59-bbb0-532dd07dfcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93fdea9-55e8-40a3-9dc2-4b8840c05c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b93fdea9-55e8-40a3-9dc2-4b8840c05c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-76395687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c350e9c-5a7f-476a-9018-af921a340123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b2c725ff774f58a3cf4e5bfebad809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:10Z,use_quota=True,user_id='5e4d279c4c694ccf8599ff3adaa155f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca22a48e-aff2-41ad-aacd-4b6dda3a2f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca22a48e-aff2-41ad-aacd-4b6dda3a2f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7710a5b6-c552-43f3-bccc-645e772ff1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7710a5b6-c552-43f3-bccc-645e772ff1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c350e9c-5a7f-476a-9018-af921a340123', 'volume_name': 'volume-5c350e9c-5a7f-476a-9018-af921a340123', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3193c5f6-8cb9-4481-b3f7-299aaf2950ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3193c5f6-8cb9-4481-b3f7-299aaf2950ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e6e0cf-ae38-4ce6-ac90-45d83461df6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:10 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Volume 5c350e9c-5a7f-476a-9018-af921a340123: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c350e9c-5a7f-476a-9018-af921a340123', 'volume_size': 1}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-76395687',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c350e9c-5a7f-476a-9018-af921a340123,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b2c725ff774f58a3cf4e5bfebad809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:10Z,use_quota=True,user_id='5e4d279c4c694ccf8599ff3adaa155f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Creating volume 5c350e9c-5a7f-476a-9018-af921a340123 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:10 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:10 devstack sudo[89747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 1073741824
Apr 21 02:33:10 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:10 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-a96264e4-fa45-4952-bb77-ca0f5cf571e3" returned: 0 in 0.430s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-a96264e4-fa45-4952-bb77-ca0f5cf571e3" released by "delete_volume" :: held 0.985s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Created reservations ['f4d79887-bc02-48da-975d-501f46a78ec5', 'a4fd1c6c-c8e1-483f-9c7e-2b3017c1a116', '9776b00f-bf81-40af-8425-0a5e0bb7680b', '1db54fc3-335d-4b3c-8eb1-54018fd7be94'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:10 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:10 devstack sudo[89753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:10 devstack sudo[89753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b" returned: 0 in 0.487s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:10 devstack sudo[89756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b
Apr 21 02:33:10 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:10 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 1073741824" returned: 0 in 0.505s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:10 devstack sudo[89760]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123
Apr 21 02:33:10 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:10 devstack sudo[89753]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.412s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:10 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Deleted volume successfully.
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ae0cc869-1c1a-473f-b7fe-f7f3a8c9ce62 tempest-VolumesGetTest-1387231622 None] Lock "cinder-a96264e4-fa45-4952-bb77-ca0f5cf571e3-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:10 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e.6ead660a-883d-4a38-b5da-46734a0f598b" returned: 0 in 0.447s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-6ead660a-883d-4a38-b5da-46734a0f598b" released by "_delete_snapshot" :: held 2.091s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-3579fb8c-ff8b-47c5-982e-2adf06999e1e" released by "delete_snapshot" :: held 2.101s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created reservations ['8d5e06ed-dc8d-467c-b03d-6acea23436f9', '63c289e9-cf0c-48e0-bbbb-f85bb6623ef2', '2fec8595-773f-4f15-8eef-7ccaa05d2543', '119e83b0-9697-47d9-a7cd-ab0792094c36'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:11 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Delete snapshot completed successfully.
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-077fd471-9c68-4a1e-a43f-fce500d4d103 tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-6ead660a-883d-4a38-b5da-46734a0f598b-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:11 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123" returned: 0 in 0.414s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99e6e0cf-ae38-4ce6-ac90-45d83461df6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c350e9c-5a7f-476a-9018-af921a340123', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982624be-79cd-4ad5-ad56-55df894483b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:11 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Volume volume-5c350e9c-5a7f-476a-9018-af921a340123 (5c350e9c-5a7f-476a-9018-af921a340123): created successfully
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (982624be-79cd-4ad5-ad56-55df894483b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Flow 'volume_create_manager' (79d849ed-121f-4b59-bbb0-532dd07dfcde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:11 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1ae32e2f-4f85-4355-bee7-6c1f2a46a542 tempest-VolumeDependencyTests-2081146066 None] Created volume successfully.
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-2d97506d-7fb7-408a-bc71-92b8c4223923-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Lock "cinder-2d97506d-7fb7-408a-bc71-92b8c4223923-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Acquiring lock "cinder-quobyte-2d97506d-7fb7-408a-bc71-92b8c4223923" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-2d97506d-7fb7-408a-bc71-92b8c4223923" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab5e71c-2609-4a13-8fcc-b1cce820eb54]: (4, 'raw') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:11 devstack sudo[89766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923
Apr 21 02:33:11 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-3579fb8c-ff8b-47c5-982e-2adf06999e1e-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-3579fb8c-ff8b-47c5-982e-2adf06999e1e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "cinder-quobyte-3579fb8c-ff8b-47c5-982e-2adf06999e1e" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-3579fb8c-ff8b-47c5-982e-2adf06999e1e" acquired by "delete_volume" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd887fa-9987-4195-ad9f-58a68fe392c7]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:12 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923" returned: 0 in 0.477s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:12 devstack sudo[89770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e
Apr 21 02:33:12 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:12 devstack sudo[89771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923
Apr 21 02:33:12 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] Creating offline snapshot ce1fd92e-7b91-4395-bf5a-18065bc516da of volume 5c350e9c-5a7f-476a-9018-af921a340123 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c212ee28-0c36-44e9-81fc-090990eb501d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:12 devstack sudo[89776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123
Apr 21 02:33:12 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:12 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e" returned: 0 in 0.475s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:12 devstack sudo[89783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e
Apr 21 02:33:12 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:12 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923" returned: 1 in 0.507s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923' failed. Not Retrying. {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:12 devstack sudo[89786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923
Apr 21 02:33:12 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:12 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123" returned: 0 in 0.469s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:12 devstack sudo[89791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da 1G
Apr 21 02:33:12 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:12 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3579fb8c-ff8b-47c5-982e-2adf06999e1e" returned: 0 in 0.430s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-quobyte-3579fb8c-ff8b-47c5-982e-2adf06999e1e" released by "delete_volume" :: held 0.940s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Created reservations ['cb1bbed2-a82c-4774-8a7c-e2b4af75d786', 'db97d3ef-7311-4ffb-9ff7-3493af830cc3', '751cf4b4-3f20-4978-8f00-ae3c61e04fb8', 'f609153d-4eec-41aa-b563-a7496e3f229a'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:13 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2d97506d-7fb7-408a-bc71-92b8c4223923" returned: 0 in 0.435s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Lock "cinder-quobyte-2d97506d-7fb7-408a-bc71-92b8c4223923" released by "delete_volume" :: held 1.467s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:13 devstack sudo[89795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:13 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Created reservations ['64b0de7b-8111-4bf6-ae4d-988588370dd0', 'cc0f9ddb-39b7-409f-82ce-7a8e7973ab18', '7a18bd2d-b922-4cbc-beb1-68b03bdf4a1e', '3df1ab6e-8a8f-42f9-9aae-5080d1fc018e'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:13 devstack sudo[89798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:13 devstack sudo[89798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:13 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da 1G" returned: 0 in 0.526s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c350e9c-5a7f-476a-9018-af921a340123 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:13 devstack sudo[89802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c350e9c-5a7f-476a-9018-af921a340123 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da
Apr 21 02:33:13 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:13 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.554s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:13 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Deleted volume successfully.
Apr 21 02:33:13 devstack sudo[89798]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.484s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-43158321-0e1b-4087-b456-de3b2f0412cc tempest-CreateVolumesFromSnapshotTest-1922662727 None] Lock "cinder-3579fb8c-ff8b-47c5-982e-2adf06999e1e-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:13 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Deleted volume successfully.
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ef39248d-7214-4e83-aa88-01afc20be64c tempest-VolumesGetTest-1387231622 None] Lock "cinder-2d97506d-7fb7-408a-bc71-92b8c4223923-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:13 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c350e9c-5a7f-476a-9018-af921a340123 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da" returned: 0 in 0.542s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:13 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da is being set with open permissions: ugo+rw
Apr 21 02:33:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:13 devstack sudo[89809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da
Apr 21 02:33:13 devstack sudo[89809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:14 devstack sudo[89809]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da" returned: 0 in 0.502s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:14 devstack sudo[89812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.info
Apr 21 02:33:14 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Flow 'volume_create_manager' (a0b59c94-47df-4918-a507-869797473cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570798d6-435a-4a69-9e7c-8703df0bf6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570798d6-435a-4a69-9e7c-8703df0bf6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90670a9-04a3-466b-972a-5c61cb21ae9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe16e17635141e4bd2c70e29e47ac9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:15Z,use_quota=True,user_id='9f46325804b44f5d8a8264a9e35927b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035cc70a-4c39-4709-9c4f-9deb62751f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (035cc70a-4c39-4709-9c4f-9deb62751f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d0e99f-ed76-4bdd-bc8e-d48c4e986685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d0e99f-ed76-4bdd-bc8e-d48c4e986685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c90670a9-04a3-466b-972a-5c61cb21ae9a', 'volume_name': 'volume-c90670a9-04a3-466b-972a-5c61cb21ae9a', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a272da-6528-4cfc-b50a-8108cb539f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a272da-6528-4cfc-b50a-8108cb539f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdaa387d-2f22-426f-bb35-cb480ea409bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:14 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Volume c90670a9-04a3-466b-972a-5c61cb21ae9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c90670a9-04a3-466b-972a-5c61cb21ae9a', 'volume_size': 1}
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:14 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.info" returned: 0 in 0.558s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:14 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.info is being set with open permissions: ugo+rw
Apr 21 02:33:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:15 devstack sudo[89815]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.info
Apr 21 02:33:15 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Flow 'volume_create_manager' (1b2e08e4-cb34-405a-ab2a-6fadf0148744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85525b3d-202f-4383-a1f1-35f86b765b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:15 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85525b3d-202f-4383-a1f1-35f86b765b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-366487919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aae66a5-3df8-4f67-b1c1-6ebe91808860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7f34ec97d04a8393bddf13f6b88c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:15Z,use_quota=True,user_id='1164fcf95cc343f083a304cd1f0442b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42aa3784-28b7-4a5f-b7df-c9ed24546c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42aa3784-28b7-4a5f-b7df-c9ed24546c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741c104f-9be2-4dcc-a31c-4386e3dbed42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (741c104f-9be2-4dcc-a31c-4386e3dbed42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0aae66a5-3df8-4f67-b1c1-6ebe91808860', 'volume_name': 'volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865b45cf-d723-4a34-a337-3efe6b89a027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865b45cf-d723-4a34-a337-3efe6b89a027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c788eabe-64c3-4ccb-bb4a-f398e5c54d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:15 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Volume 0aae66a5-3df8-4f67-b1c1-6ebe91808860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860', 'volume_size': 1}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.info" returned: 0 in 0.496s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.159s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.516s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c90670a9-04a3-466b-972a-5c61cb21ae9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe16e17635141e4bd2c70e29e47ac9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:15Z,use_quota=True,user_id='9f46325804b44f5d8a8264a9e35927b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Creating volume c90670a9-04a3-466b-972a-5c61cb21ae9a {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:15 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:15 devstack sudo[89818]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a 1073741824
Apr 21 02:33:15 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:15 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c8cc21ab-840f-4fd5-97af-0f8aca761b3f tempest-VolumeDependencyTests-2081146066 None] Create snapshot completed successfully
Apr 21 02:33:16 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a 1073741824" returned: 0 in 0.502s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=181,cinder:UPDATE=213,cinder:DELETE=23,cinder:INSERT=64 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:16 devstack sudo[89823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a
Apr 21 02:33:16 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:16 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a" returned: 0 in 0.412s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.958s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-366487919',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0aae66a5-3df8-4f67-b1c1-6ebe91808860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e7f34ec97d04a8393bddf13f6b88c26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:15Z,use_quota=True,user_id='1164fcf95cc343f083a304cd1f0442b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Creating volume 0aae66a5-3df8-4f67-b1c1-6ebe91808860 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:16 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdaa387d-2f22-426f-bb35-cb480ea409bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c90670a9-04a3-466b-972a-5c61cb21ae9a', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7887d3bc-7aec-40ed-bf3a-ce270550481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:16 devstack sudo[89826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860 1073741824
Apr 21 02:33:16 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:16 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Volume volume-c90670a9-04a3-466b-972a-5c61cb21ae9a (c90670a9-04a3-466b-972a-5c61cb21ae9a): created successfully
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7887d3bc-7aec-40ed-bf3a-ce270550481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Flow 'volume_create_manager' (a0b59c94-47df-4918-a507-869797473cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:16 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ce7ecaf4-0f48-4f88-8e71-10b71de9aeb2 tempest-CinderUnicodeTest-279531807 None] Created volume successfully.
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Flow 'volume_create_manager' (8d5c9a06-55fe-465c-824a-bf4f6fd0278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849e61fa-5469-495c-988f-638f4a37d3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849e61fa-5469-495c-988f-638f4a37d3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-438422316',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=072c30fe-b9de-46f1-b0bd-5b3a3e5998cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b2c725ff774f58a3cf4e5bfebad809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ce1fd92e-7b91-4395-bf5a-18065bc516da,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:17Z,use_quota=True,user_id='5e4d279c4c694ccf8599ff3adaa155f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7d4f19-682d-4e00-890f-66c3d877f52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7d4f19-682d-4e00-890f-66c3d877f52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b64acfa-b8b9-4439-bc88-fc5caa255c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b64acfa-b8b9-4439-bc88-fc5caa255c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '072c30fe-b9de-46f1-b0bd-5b3a3e5998cc', 'volume_name': 'volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc', 'volume_size': 1, 'snapshot_id': 'ce1fd92e-7b91-4395-bf5a-18065bc516da'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85659d9-6826-4cc1-b644-f9eb20e2c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c85659d9-6826-4cc1-b644-f9eb20e2c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b525bbe-c35e-48dc-91b1-d8433ae61979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:16 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Volume 072c30fe-b9de-46f1-b0bd-5b3a3e5998cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc', 'volume_size': 1, 'snapshot_id': 'ce1fd92e-7b91-4395-bf5a-18065bc516da'}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:16 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860 1073741824" returned: 0 in 0.496s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:16 devstack sudo[89831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860
Apr 21 02:33:16 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Flow 'volume_create_manager' (3c87c695-61e6-42ed-a512-7ad1c80cca20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e471f48f-f3fc-4dd5-bed0-690232f4d74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e471f48f-f3fc-4dd5-bed0-690232f4d74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-613549752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9c5833-3287-40fc-bee8-4bfcda5bad27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe16e17635141e4bd2c70e29e47ac9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:17Z,use_quota=True,user_id='9f46325804b44f5d8a8264a9e35927b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457a5897-0ec5-4fc5-aa50-22f280b01445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457a5897-0ec5-4fc5-aa50-22f280b01445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03270828-e61e-4eb1-8adc-679721b261b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03270828-e61e-4eb1-8adc-679721b261b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d9c5833-3287-40fc-bee8-4bfcda5bad27', 'volume_name': 'volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79480eb-726d-474b-8fdf-bd6c70fa9bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f79480eb-726d-474b-8fdf-bd6c70fa9bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b24e252-814a-40fb-b252-99cd41338931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:17 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Volume 1d9c5833-3287-40fc-bee8-4bfcda5bad27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27', 'volume_size': 1}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:17 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860" returned: 0 in 0.449s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.569s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-quobyte-ce1fd92e-7b91-4395-bf5a-18065bc516da-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" by "_create_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c788eabe-64c3-4ccb-bb4a-f398e5c54d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276a0411-bcab-48e6-90c7-03bd7ef6cdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-ce1fd92e-7b91-4395-bf5a-18065bc516da-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Creating volume 072c30fe-b9de-46f1-b0bd-5b3a3e5998cc from snapshot ce1fd92e-7b91-4395-bf5a-18065bc516da {{(pid=82686) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-quobyte-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:17 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Volume volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860 (0aae66a5-3df8-4f67-b1c1-6ebe91808860): created successfully
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (276a0411-bcab-48e6-90c7-03bd7ef6cdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Flow 'volume_create_manager' (1b2e08e4-cb34-405a-ab2a-6fadf0148744) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:17 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-54544754-6194-4e8e-a446-9d9018b24222 tempest-VolumesNegativeTest-148167255 None] Created volume successfully.
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] snapshot: ce1fd92e-7b91-4395-bf5a-18065bc516da, volume: 072c30fe-b9de-46f1-b0bd-5b3a3e5998cc,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff59e8-9988-47d5-b7da-c0349e3c1e73]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:17 devstack sudo[89834]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da
Apr 21 02:33:17 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:17 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da" returned: 0 in 0.455s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c350e9c-5a7f-476a-9018-af921a340123(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a90797-f72a-4eaa-a31e-93ffce7cdb1d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:18 devstack sudo[89839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123
Apr 21 02:33:18 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:18 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123" returned: 0 in 0.467s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:18 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:33:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:18 devstack sudo[89844]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc
Apr 21 02:33:18 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:20 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" returned: 0 in 2.210s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:20 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[56956c3c-faa9-463f-bde7-ac78eb1e999b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:20 devstack sudo[89860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123
Apr 21 02:33:20 devstack sudo[89860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:21 devstack sudo[89860]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123" returned: 0 in 0.616s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:33:21 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Converted 1024.00 MB image at 463.14 MB/s
Apr 21 02:33:21 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc is being set with open permissions: ugo+rw
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:21 devstack sudo[89865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc
Apr 21 02:33:21 devstack sudo[89865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:21 devstack sudo[89865]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" returned: 0 in 0.415s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" released by "_copy_volume_from_snapshot" :: held 4.216s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-ce1fd92e-7b91-4395-bf5a-18065bc516da-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" released by "_create_volume_from_snapshot" :: held 4.256s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.276s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.339s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-613549752',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d9c5833-3287-40fc-bee8-4bfcda5bad27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fe16e17635141e4bd2c70e29e47ac9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:17Z,use_quota=True,user_id='9f46325804b44f5d8a8264a9e35927b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Creating volume 1d9c5833-3287-40fc-bee8-4bfcda5bad27 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:21 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:21 devstack sudo[89869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 1073741824
Apr 21 02:33:21 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b525bbe-c35e-48dc-91b1-d8433ae61979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc', 'volume_size': 1, 'snapshot_id': 'ce1fd92e-7b91-4395-bf5a-18065bc516da'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6b531e-6db1-4539-a6b7-da5e6edd16e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:21 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Volume volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc (072c30fe-b9de-46f1-b0bd-5b3a3e5998cc): created successfully
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6b531e-6db1-4539-a6b7-da5e6edd16e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Flow 'volume_create_manager' (8d5c9a06-55fe-465c-824a-bf4f6fd0278c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:21 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c0077b91-a1fc-4d7b-9b57-be8f6a1a77e0 tempest-VolumeDependencyTests-2081146066 None] Created volume successfully.
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-ce1fd92e-7b91-4395-bf5a-18065bc516da-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-ce1fd92e-7b91-4395-bf5a-18065bc516da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-quobyte-5c350e9c-5a7f-476a-9018-af921a340123" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-5c350e9c-5a7f-476a-9018-af921a340123" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-quobyte-ce1fd92e-7b91-4395-bf5a-18065bc516da" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-ce1fd92e-7b91-4395-bf5a-18065bc516da" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Deleting offline snapshot ce1fd92e-7b91-4395-bf5a-18065bc516da of volume 5c350e9c-5a7f-476a-9018-af921a340123 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] snapshot_file for this snap is: volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[0519d579-4119-4241-9394-a2673f826d45]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:22 devstack sudo[89874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da
Apr 21 02:33:22 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:22 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 1073741824" returned: 0 in 0.502s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:22 devstack sudo[89876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27
Apr 21 02:33:22 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:22 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da" returned: 0 in 0.509s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c350e9c-5a7f-476a-9018-af921a340123(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95ec60a-07ea-46fd-aedd-77b8f1fcc471]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:22 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27" returned: 0 in 0.457s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:22 devstack sudo[89882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123
Apr 21 02:33:22 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b24e252-814a-40fb-b252-99cd41338931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cffa74-50a0-4024-b9cd-c6207693bdef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:22 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Volume volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 (1d9c5833-3287-40fc-bee8-4bfcda5bad27): created successfully
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3cffa74-50a0-4024-b9cd-c6207693bdef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Flow 'volume_create_manager' (3c87c695-61e6-42ed-a512-7ad1c80cca20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:22 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-2d366288-09c4-4c0a-9bcf-7269b3c10748 tempest-CinderUnicodeTest-279531807 None] Created volume successfully.
Apr 21 02:33:23 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123" returned: 0 in 0.482s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:23 devstack sudo[89887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da
Apr 21 02:33:23 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:23 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da" returned: 0 in 0.452s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:23 devstack sudo[89892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da
Apr 21 02:33:23 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] Creating offline snapshot 831cccb3-c828-4fff-95d2-d5bb8dc4cc93 of volume 1d9c5833-3287-40fc-bee8-4bfcda5bad27 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:33:23 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3b1136-bf37-4735-b3af-93ad1a990ece]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:24 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123.ce1fd92e-7b91-4395-bf5a-18065bc516da" returned: 0 in 0.462s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:24 devstack sudo[89895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27
Apr 21 02:33:24 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-ce1fd92e-7b91-4395-bf5a-18065bc516da" released by "_delete_snapshot" :: held 1.965s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-5c350e9c-5a7f-476a-9018-af921a340123" released by "delete_snapshot" :: held 1.978s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Created reservations ['2121ab19-4d90-45d4-9f75-3873f1b985c6', 'a4dc53de-d8aa-4ac2-97fb-72e85ae809f6', '0e1eea54-586d-435a-92cf-71e9b9dca1b9', '90973790-9d51-489f-8ee9-44789b9560a3'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:24 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Delete snapshot completed successfully.
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f958c88e-1bc0-4088-a968-1462b38cacc4 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-ce1fd92e-7b91-4395-bf5a-18065bc516da-delete_snapshot" released by "delete_snapshot" :: held 2.069s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-5c350e9c-5a7f-476a-9018-af921a340123-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-5c350e9c-5a7f-476a-9018-af921a340123-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-quobyte-5c350e9c-5a7f-476a-9018-af921a340123" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-5c350e9c-5a7f-476a-9018-af921a340123" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe118a1-9d06-4b8a-a66a-f18458e20804]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:24 devstack sudo[89897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123
Apr 21 02:33:24 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:24 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27" returned: 0 in 0.588s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:24 devstack sudo[89902]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93 1G
Apr 21 02:33:24 devstack sudo[89902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:24 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123" returned: 0 in 0.539s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:24 devstack sudo[89907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123
Apr 21 02:33:24 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:25 devstack sudo[89902]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93 1G" returned: 0 in 0.555s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:25 devstack sudo[89912]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93
Apr 21 02:33:25 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:25 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c350e9c-5a7f-476a-9018-af921a340123" returned: 0 in 0.501s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-5c350e9c-5a7f-476a-9018-af921a340123" released by "delete_volume" :: held 1.071s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Created reservations ['9156702c-f44f-4548-99cf-0ff736697329', '934904f5-3cd2-4018-8a5e-d28c4b73836d', '2e270171-338e-4b45-b08b-ecc7ce0fc2db', 'c5b6a328-c567-4268-927e-6ae9d89d70a1'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:25 devstack sudo[89915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:25 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:25 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93" returned: 0 in 0.535s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:25 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93 is being set with open permissions: ugo+rw
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:25 devstack sudo[89921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93
Apr 21 02:33:25 devstack sudo[89921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:25 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.476s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:25 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Deleted volume successfully.
Apr 21 02:33:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3f213894-fb56-4657-ac93-e41e8b5b952c tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-5c350e9c-5a7f-476a-9018-af921a340123-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:26 devstack sudo[89921]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93" returned: 0 in 0.408s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:26 devstack sudo[89929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.info
Apr 21 02:33:26 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:26 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.info" returned: 0 in 0.464s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:26 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.info is being set with open permissions: ugo+rw
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:26 devstack sudo[89943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.info
Apr 21 02:33:26 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Flow 'volume_create_manager' (8891f761-7284-4ed2-b485-ce5f54627e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3c3fc2-5669-4788-9e9a-f70b92a362d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a3c3fc2-5669-4788-9e9a-f70b92a362d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-574770092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c00999e-cfd5-43dd-9fda-a9d32c7249ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b2c725ff774f58a3cf4e5bfebad809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:27Z,use_quota=True,user_id='5e4d279c4c694ccf8599ff3adaa155f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c181fd2-8fff-43aa-980e-f1dcdebb2789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c181fd2-8fff-43aa-980e-f1dcdebb2789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd3b319-7c03-4739-ab19-d76664bd8275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd3b319-7c03-4739-ab19-d76664bd8275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c00999e-cfd5-43dd-9fda-a9d32c7249ef', 'volume_name': 'volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b701a0a4-2bda-4249-852b-9a97633af19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b701a0a4-2bda-4249-852b-9a97633af19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938633ba-3c23-49e5-9d51-799c9053f608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:26 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Volume 5c00999e-cfd5-43dd-9fda-a9d32c7249ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef', 'volume_size': 1}
Apr 21 02:33:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:27 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.info" returned: 0 in 0.477s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.080s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-574770092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c00999e-cfd5-43dd-9fda-a9d32c7249ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b2c725ff774f58a3cf4e5bfebad809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:27Z,use_quota=True,user_id='5e4d279c4c694ccf8599ff3adaa155f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Creating volume 5c00999e-cfd5-43dd-9fda-a9d32c7249ef {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:27 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:27 devstack sudo[89946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef 1073741824
Apr 21 02:33:27 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-a5b4e291-84cd-4886-abae-8784b92aae28 tempest-CinderUnicodeTest-279531807 None] Create snapshot completed successfully
Apr 21 02:33:27 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:27 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef 1073741824" returned: 0 in 0.523s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:27 devstack sudo[89951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef
Apr 21 02:33:27 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:27 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef" returned: 0 in 0.416s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (938633ba-3c23-49e5-9d51-799c9053f608) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4fa6e1-8292-4164-8e57-514802f86619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:28 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Volume volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef (5c00999e-cfd5-43dd-9fda-a9d32c7249ef): created successfully
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf4fa6e1-8292-4164-8e57-514802f86619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Flow 'volume_create_manager' (8891f761-7284-4ed2-b485-ce5f54627e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:28 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f8dd5e79-4416-4d60-bfa8-8e5e436d91b3 tempest-VolumeDependencyTests-2081146066 None] Created volume successfully.
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Acquiring lock "cinder-831cccb3-c828-4fff-95d2-d5bb8dc4cc93-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Lock "cinder-831cccb3-c828-4fff-95d2-d5bb8dc4cc93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Acquiring lock "cinder-quobyte-1d9c5833-3287-40fc-bee8-4bfcda5bad27" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Lock "cinder-quobyte-1d9c5833-3287-40fc-bee8-4bfcda5bad27" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Acquiring lock "cinder-quobyte-831cccb3-c828-4fff-95d2-d5bb8dc4cc93" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Lock "cinder-quobyte-831cccb3-c828-4fff-95d2-d5bb8dc4cc93" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Deleting offline snapshot 831cccb3-c828-4fff-95d2-d5bb8dc4cc93 of volume 1d9c5833-3287-40fc-bee8-4bfcda5bad27 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] snapshot_file for this snap is: volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c16b946-db2a-4d81-b5f0-1967443f85ab]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:28 devstack sudo[89954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93
Apr 21 02:33:28 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:28 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93" returned: 0 in 0.505s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdac05ae-d8ec-4034-9fc3-937ef9586215]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:28 devstack sudo[89962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27
Apr 21 02:33:28 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Flow 'volume_create_manager' (4abe5589-91f1-4c2f-910a-a013c8ab8e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6130d0d8-dd42-464b-9130-7175f8e13c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6130d0d8-dd42-464b-9130-7175f8e13c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1940139761',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6256db3-17cc-4832-b85b-fe33e3e83084,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25b2c725ff774f58a3cf4e5bfebad809',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=5c00999e-cfd5-43dd-9fda-a9d32c7249ef,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:29Z,use_quota=True,user_id='5e4d279c4c694ccf8599ff3adaa155f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5157b51-2da9-4971-9c7b-f0b8dc3c8f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5157b51-2da9-4971-9c7b-f0b8dc3c8f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebed46e-420b-4883-97c4-1de1018fbdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ebed46e-420b-4883-97c4-1de1018fbdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd6256db3-17cc-4832-b85b-fe33e3e83084', 'volume_name': 'volume-d6256db3-17cc-4832-b85b-fe33e3e83084', 'volume_size': 1, 'source_volid': '5c00999e-cfd5-43dd-9fda-a9d32c7249ef', 'source_volstatus': 'available'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d75190-eb52-40a2-a04b-3eeb5ecf15d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d75190-eb52-40a2-a04b-3eeb5ecf15d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:28 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4396cb-0008-476e-941f-f39024fce76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:28 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Volume d6256db3-17cc-4832-b85b-fe33e3e83084: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d6256db3-17cc-4832-b85b-fe33e3e83084', 'volume_size': 1, 'source_volid': '5c00999e-cfd5-43dd-9fda-a9d32c7249ef', 'source_volstatus': 'available'}
Apr 21 02:33:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:29 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Cloning volume 5c00999e-cfd5-43dd-9fda-a9d32c7249ef to volume d6256db3-17cc-4832-b85b-fe33e3e83084
Apr 21 02:33:29 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Creating offline snapshot 4d2bc3e8-a311-4fa6-a38c-58e8fd145472 of volume 5c00999e-cfd5-43dd-9fda-a9d32c7249ef {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:33:29 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc639769-c509-4e5f-a78a-c770d5cedb0a]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:29 devstack sudo[89964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef
Apr 21 02:33:29 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:29 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27" returned: 0 in 0.564s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:29 devstack sudo[89969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93
Apr 21 02:33:29 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:29 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef" returned: 0 in 0.515s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:29 devstack sudo[89974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472 1G
Apr 21 02:33:29 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:29 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93" returned: 0 in 0.473s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:29 devstack sudo[89979]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93
Apr 21 02:33:29 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:30 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472 1G" returned: 0 in 0.494s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:30 devstack sudo[89984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472
Apr 21 02:33:30 devstack sudo[89984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:30 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27.831cccb3-c828-4fff-95d2-d5bb8dc4cc93" returned: 0 in 0.513s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Lock "cinder-quobyte-831cccb3-c828-4fff-95d2-d5bb8dc4cc93" released by "_delete_snapshot" :: held 2.125s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Lock "cinder-quobyte-1d9c5833-3287-40fc-bee8-4bfcda5bad27" released by "delete_snapshot" :: held 2.143s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Created reservations ['01ee533d-8d75-421a-b574-63ddfe8dd6b0', '712e9f83-34fa-4050-a178-71c2e9be45b6', '8041fcb6-acdf-429d-b3c7-21c226715cfa', 'd879306d-bf7c-4d09-947d-c49216c5164a'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:30 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Delete snapshot completed successfully.
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-de559673-80bc-443f-8650-fdcc7cd4b274 tempest-CinderUnicodeTest-279531807 None] Lock "cinder-831cccb3-c828-4fff-95d2-d5bb8dc4cc93-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Acquiring lock "cinder-1d9c5833-3287-40fc-bee8-4bfcda5bad27-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Lock "cinder-1d9c5833-3287-40fc-bee8-4bfcda5bad27-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Acquiring lock "cinder-quobyte-1d9c5833-3287-40fc-bee8-4bfcda5bad27" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Lock "cinder-quobyte-1d9c5833-3287-40fc-bee8-4bfcda5bad27" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[2506ec96-8922-419f-8ff5-c581806a9949]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:30 devstack sudo[89984]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472" returned: 0 in 0.640s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:30 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472 is being set with open permissions: ugo+rw
Apr 21 02:33:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:30 devstack sudo[90017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472
Apr 21 02:33:30 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:30 devstack sudo[90016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27
Apr 21 02:33:30 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:31 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472" returned: 0 in 0.460s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:31 devstack sudo[90026]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.info
Apr 21 02:33:31 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:31 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27" returned: 0 in 0.575s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:31 devstack sudo[90028]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27
Apr 21 02:33:31 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:31 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.info" returned: 0 in 0.436s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:31 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.info is being set with open permissions: ugo+rw
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:31 devstack sudo[90032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.info
Apr 21 02:33:31 devstack sudo[90032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:31 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d9c5833-3287-40fc-bee8-4bfcda5bad27" returned: 0 in 0.527s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Lock "cinder-quobyte-1d9c5833-3287-40fc-bee8-4bfcda5bad27" released by "delete_volume" :: held 1.144s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Created reservations ['466d0e7c-3e56-48d9-94f2-73eb9a5a9a4a', '48b4e89d-15ba-404d-b6c4-e00a852786bc', '0769363d-1f8e-40d2-b1d7-6edc7280e6cb', 'c93d00f7-3cee-4ac9-adcd-549849257f41'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:31 devstack sudo[90035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:31 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:32 devstack sudo[90032]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.info" returned: 0 in 0.482s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-quobyte-d6256db3-17cc-4832-b85b-fe33e3e83084" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-d6256db3-17cc-4832-b85b-fe33e3e83084" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] snapshot: 4d2bc3e8-a311-4fa6-a38c-58e8fd145472, volume: d6256db3-17cc-4832-b85b-fe33e3e83084,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaca210d-619f-4089-94de-0662b429da20]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:32 devstack sudo[90038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472
Apr 21 02:33:32 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:32 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.433s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Deleted volume successfully.
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-edf6844b-f82f-4eeb-ba53-0c84c1cecb9e tempest-CinderUnicodeTest-279531807 None] Lock "cinder-1d9c5833-3287-40fc-bee8-4bfcda5bad27-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:32 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472" returned: 0 in 0.516s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[26797b6a-9509-49a5-b662-add7b142ce8a]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Acquiring lock "cinder-c90670a9-04a3-466b-972a-5c61cb21ae9a-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:32 devstack sudo[90044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef
Apr 21 02:33:32 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Lock "cinder-c90670a9-04a3-466b-972a-5c61cb21ae9a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Acquiring lock "cinder-quobyte-c90670a9-04a3-466b-972a-5c61cb21ae9a" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Lock "cinder-quobyte-c90670a9-04a3-466b-972a-5c61cb21ae9a" acquired by "delete_volume" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97dd755-832b-42a5-9b14-9b80f92bb0b3]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:32 devstack sudo[90046]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a
Apr 21 02:33:32 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:33 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef" returned: 0 in 0.672s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:33 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084 not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:33:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:33 devstack sudo[90055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084
Apr 21 02:33:33 devstack sudo[90055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:33 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a" returned: 0 in 0.580s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:33 devstack sudo[90057]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a
Apr 21 02:33:33 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:33 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-c90670a9-04a3-466b-972a-5c61cb21ae9a" returned: 0 in 0.444s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Lock "cinder-quobyte-c90670a9-04a3-466b-972a-5c61cb21ae9a" released by "delete_volume" :: held 1.064s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:33 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Created reservations ['28e63c43-e2d8-4d18-a0c5-a9a3dee64dc9', 'f4c3e682-8dac-4ad1-8a75-d72dc000f5df', '24ccc08c-3b7d-4e1a-a9f4-918c14ce11db', 'bb514a34-ca72-4a9c-a41d-c2bf780e6c51'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:34 devstack sudo[90070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:34 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:35 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 1.521s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:35 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:35 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Deleted volume successfully.
Apr 21 02:33:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-07cf9091-8a5e-42d6-ab0a-cc4074953b32 tempest-CinderUnicodeTest-279531807 None] Lock "cinder-c90670a9-04a3-466b-972a-5c61cb21ae9a-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:35 devstack sudo[90055]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084" returned: 0 in 2.494s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:35 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41b5346-cc77-413c-8b6b-81e74a183d69]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:35 devstack sudo[90101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef
Apr 21 02:33:35 devstack sudo[90101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:36 devstack sudo[90101]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef" returned: 0 in 0.734s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:36 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:33:36 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Converted 1024.00 MB image at 410.45 MB/s
Apr 21 02:33:36 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084 is being set with open permissions: ugo+rw
Apr 21 02:33:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:36 devstack sudo[90107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084
Apr 21 02:33:36 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:37 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084" returned: 0 in 0.428s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-d6256db3-17cc-4832-b85b-fe33e3e83084" released by "_copy_volume_from_snapshot" :: held 4.895s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:INSERT=75,cinder:SELECT=198,cinder:UPDATE=261,cinder:DELETE=17 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-quobyte-4d2bc3e8-a311-4fa6-a38c-58e8fd145472" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-4d2bc3e8-a311-4fa6-a38c-58e8fd145472" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Deleting offline snapshot 4d2bc3e8-a311-4fa6-a38c-58e8fd145472 of volume 5c00999e-cfd5-43dd-9fda-a9d32c7249ef {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] snapshot_file for this snap is: volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b82e5a2-15db-4066-b9a8-eb2dda7644b4]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:37 devstack sudo[90110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472
Apr 21 02:33:37 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:37 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472" returned: 0 in 0.484s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d935ee7-d280-4fce-8ec8-65ef23a67ece]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:37 devstack sudo[90115]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef
Apr 21 02:33:37 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:37 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef" returned: 0 in 0.466s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:38 devstack sudo[90120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472
Apr 21 02:33:38 devstack sudo[90120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:38 devstack sudo[90120]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472" returned: 0 in 0.487s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:38 devstack sudo[90125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472
Apr 21 02:33:38 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:38 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef.4d2bc3e8-a311-4fa6-a38c-58e8fd145472" returned: 0 in 0.449s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-4d2bc3e8-a311-4fa6-a38c-58e8fd145472" released by "_delete_snapshot" :: held 1.927s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.964s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb4396cb-0008-476e-941f-f39024fce76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6256db3-17cc-4832-b85b-fe33e3e83084', 'volume_size': 1, 'source_volid': '5c00999e-cfd5-43dd-9fda-a9d32c7249ef', 'source_volstatus': 'available'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23919b28-8e0a-4e64-b1cb-2fbccba9baa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:38 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Volume volume-d6256db3-17cc-4832-b85b-fe33e3e83084 (d6256db3-17cc-4832-b85b-fe33e3e83084): created successfully
Apr 21 02:33:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23919b28-8e0a-4e64-b1cb-2fbccba9baa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:39 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Flow 'volume_create_manager' (4abe5589-91f1-4c2f-910a-a013c8ab8e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:39 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d1831f0a-bc34-4136-a336-443b37999b83 tempest-VolumeDependencyTests-2081146066 None] Created volume successfully.
Apr 21 02:33:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-5c00999e-cfd5-43dd-9fda-a9d32c7249ef-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-5c00999e-cfd5-43dd-9fda-a9d32c7249ef-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-quobyte-5c00999e-cfd5-43dd-9fda-a9d32c7249ef" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-5c00999e-cfd5-43dd-9fda-a9d32c7249ef" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:39 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c9a0c6-f16f-45c9-9f8f-6826c1522710]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:39 devstack sudo[90129]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef
Apr 21 02:33:39 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:40 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef" returned: 0 in 0.521s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:40 devstack sudo[90134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef
Apr 21 02:33:40 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:40 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5c00999e-cfd5-43dd-9fda-a9d32c7249ef" returned: 0 in 0.458s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-5c00999e-cfd5-43dd-9fda-a9d32c7249ef" released by "delete_volume" :: held 1.012s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:40 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Created reservations ['3ce633a1-dd74-4c3c-95bd-6cbeae80ca18', 'd12e5cab-f5bb-48d0-8ce6-6af46f4b439d', 'ed55fc88-3d71-440b-9ba2-2ab9e4177d35', '46eccdce-e270-46a7-bf7c-30d15b48fca2'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:40 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:40 devstack sudo[90137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:40 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:41 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.454s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:41 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:41 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Deleted volume successfully.
Apr 21 02:33:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d0db47a9-13f9-4e99-a04e-d073762f5eb1 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-5c00999e-cfd5-43dd-9fda-a9d32c7249ef-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-d6256db3-17cc-4832-b85b-fe33e3e83084-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-d6256db3-17cc-4832-b85b-fe33e3e83084-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-quobyte-d6256db3-17cc-4832-b85b-fe33e3e83084" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-d6256db3-17cc-4832-b85b-fe33e3e83084" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:41 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a426fc5-22f6-4351-9679-28508ace6148]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:41 devstack sudo[90143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084
Apr 21 02:33:41 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:42 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084" returned: 0 in 0.486s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:42 devstack sudo[90148]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084
Apr 21 02:33:42 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:42 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d6256db3-17cc-4832-b85b-fe33e3e83084" returned: 0 in 0.499s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-d6256db3-17cc-4832-b85b-fe33e3e83084" released by "delete_volume" :: held 1.017s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:42 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Created reservations ['f0a4d203-3680-453d-aee3-b76433637d6c', '1a791ee2-3bde-4cc9-baab-484c2bcadd4b', '6a84d843-cfef-44aa-92e5-9ea5d9155857', '50a8d27a-92ae-4d41-b327-12ec7c6599cb'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:42 devstack sudo[90151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:42 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:43 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.450s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:43 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:43 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Deleted volume successfully.
Apr 21 02:33:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d1499c46-b31e-4f87-be39-11a64f37bbf6 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-d6256db3-17cc-4832-b85b-fe33e3e83084-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Acquiring lock "cinder-0aae66a5-3df8-4f67-b1c1-6ebe91808860-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Lock "cinder-0aae66a5-3df8-4f67-b1c1-6ebe91808860-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Acquiring lock "cinder-quobyte-0aae66a5-3df8-4f67-b1c1-6ebe91808860" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Lock "cinder-quobyte-0aae66a5-3df8-4f67-b1c1-6ebe91808860" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12fcf99-2d0e-49bd-b60e-794b7dcf5abc]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:43 devstack sudo[90154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860
Apr 21 02:33:43 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "cinder-quobyte-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[0911df3f-1d5c-4df9-8a41-3b9fcfda01b6]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:44 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860" returned: 0 in 0.490s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:44 devstack sudo[90160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860
Apr 21 02:33:44 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:44 devstack sudo[90159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc
Apr 21 02:33:44 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:44 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-0aae66a5-3df8-4f67-b1c1-6ebe91808860" returned: 0 in 0.415s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Lock "cinder-quobyte-0aae66a5-3df8-4f67-b1c1-6ebe91808860" released by "delete_volume" :: held 0.937s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:44 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" returned: 0 in 0.475s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:44 devstack sudo[90167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc
Apr 21 02:33:44 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Created reservations ['195c5539-9891-4a49-a279-810e7f7b97a6', 'f762c188-29f0-4a49-b645-2780de943fb0', '63ce80c6-8c25-488a-b322-f2c64fbe2fcb', '43eb35d1-8bde-43cb-a6fd-2fb56ed76a41'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:44 devstack sudo[90169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:44 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:44 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" returned: 0 in 0.427s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-quobyte-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc" released by "delete_volume" :: held 0.924s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Created reservations ['98320164-e7a4-4202-ad4c-69e3f0552cb5', '60a50f6f-803a-40f6-be3d-d189872465c2', '18c24f30-c502-4b6e-8efd-96296a11faa9', '02100f25-eeb8-4ab8-b4ff-76a6a027cb2c'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:45 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.461s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:45 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Deleted volume successfully.
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e31cc68d-7fee-42cf-9e85-b95f706fbaba tempest-VolumesNegativeTest-148167255 None] Lock "cinder-0aae66a5-3df8-4f67-b1c1-6ebe91808860-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:45 devstack sudo[90173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:45 devstack sudo[90173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:45 devstack sudo[90173]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.544s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:45 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Deleted volume successfully.
Apr 21 02:33:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ee1bfda7-7be5-4f51-93e9-a8f0ead50d81 tempest-VolumeDependencyTests-2081146066 None] Lock "cinder-072c30fe-b9de-46f1-b0bd-5b3a3e5998cc-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Flow 'volume_create_manager' (a6209c6c-1431-40b1-b02f-dd24a107001c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd39705d-186f-40c0-a4dc-0beacb2a10c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd39705d-186f-40c0-a4dc-0beacb2a10c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2033769200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd50a33b-1b9b-47d0-ae76-6445a1144d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb3ce62db3e44869f3a4ecdac3f174f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:47Z,use_quota=True,user_id='4b605ea595734db58ded4222dcb57047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9452597f-82c1-445c-bb58-f7991da48ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9452597f-82c1-445c-bb58-f7991da48ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d96090-c765-4817-996b-be3f7a49ea73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d96090-c765-4817-996b-be3f7a49ea73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd50a33b-1b9b-47d0-ae76-6445a1144d8f', 'volume_name': 'volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f', 'volume_size': 2}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61bb5be4-8bb8-4c0b-8d55-59020f5c621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61bb5be4-8bb8-4c0b-8d55-59020f5c621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8821309a-513d-4b27-bb87-f95326b7bb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:46 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Volume fd50a33b-1b9b-47d0-ae76-6445a1144d8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f', 'volume_size': 2}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2033769200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd50a33b-1b9b-47d0-ae76-6445a1144d8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfb3ce62db3e44869f3a4ecdac3f174f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:47Z,use_quota=True,user_id='4b605ea595734db58ded4222dcb57047',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Creating volume fd50a33b-1b9b-47d0-ae76-6445a1144d8f {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:46 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f 2147483648 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:46 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f 2147483648
Apr 21 02:33:46 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:47 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f 2147483648" returned: 0 in 0.474s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:47 devstack sudo[90181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f
Apr 21 02:33:47 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:47 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f" returned: 0 in 0.398s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8821309a-513d-4b27-bb87-f95326b7bb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f', 'volume_size': 2}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccae64d7-2621-48b3-977c-1e03e5cf2194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:47 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Volume volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f (fd50a33b-1b9b-47d0-ae76-6445a1144d8f): created successfully
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccae64d7-2621-48b3-977c-1e03e5cf2194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Flow 'volume_create_manager' (a6209c6c-1431-40b1-b02f-dd24a107001c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:47 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6b0f196d-7d51-4b53-b321-30642e318529 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Created volume successfully.
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Creating offline snapshot d971b31b-c338-4e0e-8f0e-522196e21972 of volume fd50a33b-1b9b-47d0-ae76-6445a1144d8f {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c1272f-4310-4fc4-98d7-e42158572f85]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:47 devstack sudo[90184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f
Apr 21 02:33:47 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:48 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f" returned: 0 in 0.467s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972 2G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:48 devstack sudo[90189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972 2G
Apr 21 02:33:48 devstack sudo[90189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:48 devstack sudo[90189]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972 2G" returned: 0 in 0.455s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:48 devstack sudo[90194]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972
Apr 21 02:33:48 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:49 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972" returned: 0 in 0.429s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:49 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972 is being set with open permissions: ugo+rw
Apr 21 02:33:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:49 devstack sudo[90199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972
Apr 21 02:33:49 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:49 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972" returned: 0 in 0.411s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:49 devstack sudo[90202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.info
Apr 21 02:33:49 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:50 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.info" returned: 0 in 0.415s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:50 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.info is being set with open permissions: ugo+rw
Apr 21 02:33:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:50 devstack sudo[90205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.info
Apr 21 02:33:50 devstack sudo[90205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:50 devstack sudo[90205]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.info" returned: 0 in 0.410s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.644s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:50 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-a579e9ed-0036-4178-a53d-d9de9ea6c0e4 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Create snapshot completed successfully
Apr 21 02:33:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Acquiring lock "cinder-d971b31b-c338-4e0e-8f0e-522196e21972-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "cinder-d971b31b-c338-4e0e-8f0e-522196e21972-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Acquiring lock "cinder-quobyte-fd50a33b-1b9b-47d0-ae76-6445a1144d8f" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "cinder-quobyte-fd50a33b-1b9b-47d0-ae76-6445a1144d8f" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:50 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Acquiring lock "cinder-quobyte-d971b31b-c338-4e0e-8f0e-522196e21972" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:51 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "cinder-quobyte-d971b31b-c338-4e0e-8f0e-522196e21972" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Deleting offline snapshot d971b31b-c338-4e0e-8f0e-522196e21972 of volume fd50a33b-1b9b-47d0-ae76-6445a1144d8f {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:33:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] snapshot_file for this snap is: volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:33:51 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf86011-d687-41a4-9f79-af996636365d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:51 devstack sudo[90215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972
Apr 21 02:33:51 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:51 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972" returned: 0 in 0.483s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:33:51 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e97e56f-dc50-4948-b2c9-8012cb5b241e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:51 devstack sudo[90221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f
Apr 21 02:33:51 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:51 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f" returned: 0 in 0.465s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:52 devstack sudo[90226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972
Apr 21 02:33:52 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:52 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972" returned: 0 in 0.467s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:52 devstack sudo[90231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972
Apr 21 02:33:52 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:52 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f.d971b31b-c338-4e0e-8f0e-522196e21972" returned: 0 in 0.421s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:52 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "cinder-quobyte-d971b31b-c338-4e0e-8f0e-522196e21972" released by "_delete_snapshot" :: held 1.922s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:52 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "cinder-quobyte-fd50a33b-1b9b-47d0-ae76-6445a1144d8f" released by "delete_snapshot" :: held 1.937s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:52 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Created reservations ['93dcfb20-1935-43fa-a71a-b4142583920a', 'b87c9fc4-a2fc-4591-ac1b-dfca380964dd', '6e6a2615-9a7d-4cf3-a771-0006c31bdfc9', 'a8c3b4c3-0183-4f24-ab4c-ea379798773e'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:52 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Delete snapshot completed successfully.
Apr 21 02:33:52 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-83c1c288-92a9-4307-83e3-bf859a4eacf6 tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "cinder-d971b31b-c338-4e0e-8f0e-522196e21972-delete_snapshot" released by "delete_snapshot" :: held 2.011s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Acquiring lock "cinder-fd50a33b-1b9b-47d0-ae76-6445a1144d8f-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "cinder-fd50a33b-1b9b-47d0-ae76-6445a1144d8f-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Acquiring lock "cinder-quobyte-fd50a33b-1b9b-47d0-ae76-6445a1144d8f" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:33:53 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "cinder-quobyte-fd50a33b-1b9b-47d0-ae76-6445a1144d8f" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:33:53 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc59fe41-4fd8-4158-ba56-e9e14e7d153f]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:33:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:53 devstack sudo[90234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f
Apr 21 02:33:53 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:53 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f" returned: 0 in 0.471s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:53 devstack sudo[90239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f
Apr 21 02:33:53 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:54 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-fd50a33b-1b9b-47d0-ae76-6445a1144d8f" returned: 0 in 0.413s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "cinder-quobyte-fd50a33b-1b9b-47d0-ae76-6445a1144d8f" released by "delete_volume" :: held 0.919s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Created reservations ['81219acc-3983-49ea-b015-3dd9991175bd', '3dca8fdd-9f33-4503-b023-9bf930226708', 'c0f20f5e-9e0b-450a-9421-b7375ba3d2db', '24c3a447-f177-49b9-8800-beeb1fa70875'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:54 devstack sudo[90242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:33:54 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:54 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.458s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:33:54 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Deleted volume successfully.
Apr 21 02:33:54 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-ca2c6a5b-8098-4406-ac41-3ba4efe29d8e tempest-VolumesSnapshotNegativeTestJSON-352421024 None] Lock "cinder-fd50a33b-1b9b-47d0-ae76-6445a1144d8f-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Flow 'volume_create_manager' (be3ff015-6ef8-4888-8738-b180cb600497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76d0da9-9a5a-42f5-a018-88fad5f2aeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76d0da9-9a5a-42f5-a018-88fad5f2aeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1214011127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e62f23-d398-4e67-897e-049f48189de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41fee0f1ba14aed9692d4ad3736a2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:56Z,use_quota=True,user_id='e692cd9dc73e41eb8b906ac3de1f5f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20d2360-0689-4ca9-b3bc-b0d48d8b76dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c20d2360-0689-4ca9-b3bc-b0d48d8b76dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92ad552-44d7-436a-91bd-12f4c2740b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a92ad552-44d7-436a-91bd-12f4c2740b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e62f23-d398-4e67-897e-049f48189de1', 'volume_name': 'volume-d9e62f23-d398-4e67-897e-049f48189de1', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e29c05-5051-4835-bff5-b337b31829ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e29c05-5051-4835-bff5-b337b31829ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a1d287-6e50-4d15-9055-6a985a7a1204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:55 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Volume d9e62f23-d398-4e67-897e-049f48189de1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e62f23-d398-4e67-897e-049f48189de1', 'volume_size': 1}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1214011127',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e62f23-d398-4e67-897e-049f48189de1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41fee0f1ba14aed9692d4ad3736a2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:56Z,use_quota=True,user_id='e692cd9dc73e41eb8b906ac3de1f5f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Creating volume d9e62f23-d398-4e67-897e-049f48189de1 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:55 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:55 devstack sudo[90245]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1 1073741824
Apr 21 02:33:55 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Flow 'volume_create_manager' (647e1a7d-f258-4c65-beac-77b1c1ed2b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778cfe1a-5d79-4797-b777-22f5ccb2804e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778cfe1a-5d79-4797-b777-22f5ccb2804e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1838343674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf745a5-90f8-4644-b5ec-3abab4ba596d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41fee0f1ba14aed9692d4ad3736a2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:56Z,use_quota=True,user_id='e692cd9dc73e41eb8b906ac3de1f5f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:55 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c9942f-5cf0-4348-97fd-e3bd59135bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4c9942f-5cf0-4348-97fd-e3bd59135bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe4ae50-c46d-47ca-8320-a3421a1d2b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fe4ae50-c46d-47ca-8320-a3421a1d2b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bf745a5-90f8-4644-b5ec-3abab4ba596d', 'volume_name': 'volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81878076-cf72-49d9-83e6-61b94ed56da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81878076-cf72-49d9-83e6-61b94ed56da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a5c229-57f1-4e94-bd7f-07a8228a9a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Volume 3bf745a5-90f8-4644-b5ec-3abab4ba596d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d', 'volume_size': 1}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Flow 'volume_create_manager' (a2b07fb2-e4b2-4292-965c-f2030b7aa246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30215f9-195a-449f-bcfc-4a9fede4bf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30215f9-195a-449f-bcfc-4a9fede4bf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438562046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd672f1d-80f6-4eaf-9509-78ab172602ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41fee0f1ba14aed9692d4ad3736a2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:56Z,use_quota=True,user_id='e692cd9dc73e41eb8b906ac3de1f5f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6c88e1-49db-45ef-adcf-e571f2dbf49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f6c88e1-49db-45ef-adcf-e571f2dbf49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de96bc8-4310-4e98-aa26-2eb9df133cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3de96bc8-4310-4e98-aa26-2eb9df133cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd672f1d-80f6-4eaf-9509-78ab172602ff', 'volume_name': 'volume-cd672f1d-80f6-4eaf-9509-78ab172602ff', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a17e3a2-31a6-4180-9d0d-7d158af82950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a17e3a2-31a6-4180-9d0d-7d158af82950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661bcc2f-947f-4590-8b00-589f122a41cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Volume cd672f1d-80f6-4eaf-9509-78ab172602ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd672f1d-80f6-4eaf-9509-78ab172602ff', 'volume_size': 1}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Flow 'volume_create_manager' (39205b8b-5fab-482b-9cf6-fa25b893c6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c614408-3691-45fd-8d1f-0ab79ae81d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c614408-3691-45fd-8d1f-0ab79ae81d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1758100832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41fee0f1ba14aed9692d4ad3736a2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:56Z,use_quota=True,user_id='e692cd9dc73e41eb8b906ac3de1f5f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d53482-c816-49a8-a5a0-167098f45110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d53482-c816-49a8-a5a0-167098f45110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1c09c0-e814-40ff-aa95-33fea26c506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f1c09c0-e814-40ff-aa95-33fea26c506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea', 'volume_name': 'volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93961aed-4dd8-428b-8682-4e497e984615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93961aed-4dd8-428b-8682-4e497e984615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97ffb7a-7c59-47e9-9dbd-82176f1b2bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Volume 88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea', 'volume_size': 1}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1 1073741824" returned: 0 in 0.594s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:56 devstack sudo[90250]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1
Apr 21 02:33:56 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Flow 'volume_create_manager' (212de8bd-3b17-4023-952a-8855141a581c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244e8984-81f1-4380-86dd-e1ee15f840e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (244e8984-81f1-4380-86dd-e1ee15f840e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-884195985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a4bf64-4647-45cc-9b18-e62a4f191d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41fee0f1ba14aed9692d4ad3736a2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:57Z,use_quota=True,user_id='e692cd9dc73e41eb8b906ac3de1f5f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717cd783-2237-4f99-8b57-979949267c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717cd783-2237-4f99-8b57-979949267c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5461a6b-4110-4628-b404-0b1a0def44fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5461a6b-4110-4628-b404-0b1a0def44fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a4bf64-4647-45cc-9b18-e62a4f191d49', 'volume_name': 'volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3c8559-4417-47d3-a8e1-f3e982942a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3c8559-4417-47d3-a8e1-f3e982942a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6339bb4b-7a52-476b-9e00-50b63a2ea384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Volume b1a4bf64-4647-45cc-9b18-e62a4f191d49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49', 'volume_size': 1}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:56 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1" returned: 0 in 0.403s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1838343674',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bf745a5-90f8-4644-b5ec-3abab4ba596d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41fee0f1ba14aed9692d4ad3736a2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:56Z,use_quota=True,user_id='e692cd9dc73e41eb8b906ac3de1f5f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Creating volume 3bf745a5-90f8-4644-b5ec-3abab4ba596d {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:56 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a1d287-6e50-4d15-9055-6a985a7a1204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e62f23-d398-4e67-897e-049f48189de1', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack sudo[90253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d 1073741824
Apr 21 02:33:56 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065f26cf-ad3c-420d-a55c-788bb44ba80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:56 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Volume volume-d9e62f23-d398-4e67-897e-049f48189de1 (d9e62f23-d398-4e67-897e-049f48189de1): created successfully
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (065f26cf-ad3c-420d-a55c-788bb44ba80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:56 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Flow 'volume_create_manager' (be3ff015-6ef8-4888-8738-b180cb600497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:56 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b2e7bb55-c996-42a8-bd49-11d55d1d1655 tempest-CreateVolumesFromImageTest-305653861 None] Created volume successfully.
Apr 21 02:33:57 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d 1073741824" returned: 0 in 0.481s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:57 devstack sudo[90258]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d
Apr 21 02:33:57 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:57 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d" returned: 0 in 0.400s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.583s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-438562046',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd672f1d-80f6-4eaf-9509-78ab172602ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41fee0f1ba14aed9692d4ad3736a2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:56Z,use_quota=True,user_id='e692cd9dc73e41eb8b906ac3de1f5f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Creating volume cd672f1d-80f6-4eaf-9509-78ab172602ff {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:57 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a5c229-57f1-4e94-bd7f-07a8228a9a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:57 devstack sudo[90261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff 1073741824
Apr 21 02:33:57 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac31391-9268-4939-887b-693e47bc73ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:57 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Volume volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d (3bf745a5-90f8-4644-b5ec-3abab4ba596d): created successfully
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac31391-9268-4939-887b-693e47bc73ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Flow 'volume_create_manager' (647e1a7d-f258-4c65-beac-77b1c1ed2b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:57 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-01c804d7-0b68-4a9e-8d58-596c26e675bc tempest-CreateVolumesFromImageTest-305653861 None] Created volume successfully.
Apr 21 02:33:58 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff 1073741824" returned: 0 in 0.474s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:58 devstack sudo[90266]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff
Apr 21 02:33:58 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:58 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff" returned: 0 in 0.455s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.297s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1758100832',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41fee0f1ba14aed9692d4ad3736a2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:56Z,use_quota=True,user_id='e692cd9dc73e41eb8b906ac3de1f5f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Creating volume 88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:58 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (661bcc2f-947f-4590-8b00-589f122a41cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd672f1d-80f6-4eaf-9509-78ab172602ff', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:58 devstack sudo[90303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea 1073741824
Apr 21 02:33:58 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff8430e-fe33-4d28-b339-67a9b8d8bd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:58 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Volume volume-cd672f1d-80f6-4eaf-9509-78ab172602ff (cd672f1d-80f6-4eaf-9509-78ab172602ff): created successfully
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff8430e-fe33-4d28-b339-67a9b8d8bd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Flow 'volume_create_manager' (a2b07fb2-e4b2-4292-965c-f2030b7aa246) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:58 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-29f6bb95-1538-4b1c-973c-f02fb0c5fe08 tempest-CreateVolumesFromImageTest-305653861 None] Created volume successfully.
Apr 21 02:33:59 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea 1073741824" returned: 0 in 0.474s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:59 devstack sudo[90308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea
Apr 21 02:33:59 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:59 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea" returned: 0 in 0.411s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.060s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:33:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-884195985',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a4bf64-4647-45cc-9b18-e62a4f191d49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c41fee0f1ba14aed9692d4ad3736a2c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:33:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:33:57Z,use_quota=True,user_id='e692cd9dc73e41eb8b906ac3de1f5f7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Creating volume b1a4bf64-4647-45cc-9b18-e62a4f191d49 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:33:59 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a97ffb7a-7c59-47e9-9dbd-82176f1b2bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:59 devstack sudo[90311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49 1073741824
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c091801-f499-4568-820b-a0a48203a414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:33:59 devstack sudo[90311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:33:59 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Volume volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea (88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea): created successfully
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c091801-f499-4568-820b-a0a48203a414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:33:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Flow 'volume_create_manager' (39205b8b-5fab-482b-9cf6-fa25b893c6ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:33:59 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b3b7524d-8763-4cb1-b44e-69c5349b9687 tempest-CreateVolumesFromImageTest-305653861 None] Created volume successfully.
Apr 21 02:34:00 devstack sudo[90311]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49 1073741824" returned: 0 in 0.488s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:00 devstack sudo[90316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49
Apr 21 02:34:00 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:00 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49" returned: 0 in 0.409s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6339bb4b-7a52-476b-9e00-50b63a2ea384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddc63e8-b120-4fdc-976a-b6944af2105c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:00 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Volume volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49 (b1a4bf64-4647-45cc-9b18-e62a4f191d49): created successfully
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddc63e8-b120-4fdc-976a-b6944af2105c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Flow 'volume_create_manager' (212de8bd-3b17-4023-952a-8855141a581c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:00 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9579ca44-5593-4de8-bed9-55a979f878bd tempest-CreateVolumesFromImageTest-305653861 None] Created volume successfully.
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "cinder-b1a4bf64-4647-45cc-9b18-e62a4f191d49-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-b1a4bf64-4647-45cc-9b18-e62a4f191d49-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "cinder-quobyte-b1a4bf64-4647-45cc-9b18-e62a4f191d49" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-quobyte-b1a4bf64-4647-45cc-9b18-e62a4f191d49" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7348fdb-cac1-4a9c-b33b-57a82527b543]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:01 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49
Apr 21 02:34:01 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:01 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49" returned: 0 in 0.476s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:01 devstack sudo[90325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49
Apr 21 02:34:01 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:01 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-b1a4bf64-4647-45cc-9b18-e62a4f191d49" returned: 0 in 0.396s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-quobyte-b1a4bf64-4647-45cc-9b18-e62a4f191d49" released by "delete_volume" :: held 0.897s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:01 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Created reservations ['70cbdfc4-39c6-44a5-8d8a-df5946951cc2', 'b589e2f8-a285-4e36-a1eb-c7b61c953568', 'b4858b7d-9576-41a8-bb8d-ee3baa4f95c7', 'e2de36a0-f027-4eb6-aba1-29bd0302f6dd'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:34:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:01 devstack sudo[90328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:34:01 devstack sudo[90328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "cinder-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "cinder-quobyte-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-quobyte-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[434b04e2-7ae4-40d3-9565-878af2ece3f4]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:02 devstack sudo[90330]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea
Apr 21 02:34:02 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:02 devstack sudo[90328]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.423s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:34:02 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Deleted volume successfully.
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-03e7c162-cf9f-4673-941c-adcfd32e37d3 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-b1a4bf64-4647-45cc-9b18-e62a4f191d49-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:02 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea" returned: 0 in 0.462s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:02 devstack sudo[90336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea
Apr 21 02:34:02 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG oslo_service.periodic_task [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82686) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:02 devstack sudo[90339]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:34:02 devstack sudo[90339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:02 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea" returned: 0 in 0.410s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-quobyte-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea" released by "delete_volume" :: held 0.894s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Created reservations ['90979ed7-e5c9-4626-b1ba-bb233247adda', 'ba3f8c01-9284-4e5f-b7e9-c95ef2a570e0', '55101518-455f-4005-9b8a-10cdfe59d51b', '87ad2c00-d1aa-4e96-8264-505e9ac0d722'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:03 devstack sudo[90341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:34:03 devstack sudo[90341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "cinder-cd672f1d-80f6-4eaf-9509-78ab172602ff-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-cd672f1d-80f6-4eaf-9509-78ab172602ff-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "cinder-quobyte-cd672f1d-80f6-4eaf-9509-78ab172602ff" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-quobyte-cd672f1d-80f6-4eaf-9509-78ab172602ff" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd55532f-f083-4f3d-bb11-bbf804267565]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:03 devstack sudo[90343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff
Apr 21 02:34:03 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:03 devstack sudo[90339]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.451s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:34:03 devstack sudo[90341]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.434s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:34:03 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Deleted volume successfully.
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f8b60079-0eb2-49e3-af28-8979a9d363dd tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-88f4c58c-a5d9-44ca-9bf4-309bbd6c15ea-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:03 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff" returned: 0 in 0.467s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:03 devstack sudo[90350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff
Apr 21 02:34:03 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:04 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cd672f1d-80f6-4eaf-9509-78ab172602ff" returned: 0 in 0.413s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-quobyte-cd672f1d-80f6-4eaf-9509-78ab172602ff" released by "delete_volume" :: held 0.907s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Created reservations ['4fd07cf8-1555-400b-a7e9-745e2e0d5b5b', '7635dd70-753e-42c7-b537-6d8fd23f727f', 'eb497211-0267-4a63-861a-a3cabd2d6148', '0aba6c5a-6355-4f32-b1ee-8d28cef7d4f1'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:04 devstack sudo[90353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:34:04 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "cinder-3bf745a5-90f8-4644-b5ec-3abab4ba596d-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-3bf745a5-90f8-4644-b5ec-3abab4ba596d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "cinder-quobyte-3bf745a5-90f8-4644-b5ec-3abab4ba596d" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-quobyte-3bf745a5-90f8-4644-b5ec-3abab4ba596d" acquired by "delete_volume" :: waited 0.019s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab5844c-7f0a-4058-9fac-252f7570ae4d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:04 devstack sudo[90355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d
Apr 21 02:34:04 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:04 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.423s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:34:04 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Deleted volume successfully.
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0a210584-6962-45fd-b064-22429ca3f177 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-cd672f1d-80f6-4eaf-9509-78ab172602ff-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:04 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d" returned: 0 in 0.477s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:04 devstack sudo[90361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d
Apr 21 02:34:04 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:05 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3bf745a5-90f8-4644-b5ec-3abab4ba596d" returned: 0 in 0.414s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-quobyte-3bf745a5-90f8-4644-b5ec-3abab4ba596d" released by "delete_volume" :: held 0.913s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Created reservations ['1e4b1b54-2c94-4034-8003-731173dc24ce', '24a18d07-d1c9-480d-9630-3e45712b9272', 'cd84bffa-a30d-4439-9ede-e5e367ca2ea5', '9780cd53-cbc2-46cd-963a-6298d8727296'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:05 devstack sudo[90364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:34:05 devstack sudo[90364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "cinder-d9e62f23-d398-4e67-897e-049f48189de1-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-d9e62f23-d398-4e67-897e-049f48189de1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "cinder-quobyte-d9e62f23-d398-4e67-897e-049f48189de1" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-quobyte-d9e62f23-d398-4e67-897e-049f48189de1" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c55684-3d87-4c99-8843-b8437d9b30e7]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:05 devstack sudo[90366]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1
Apr 21 02:34:05 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:05 devstack sudo[90364]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.421s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:34:05 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Deleted volume successfully.
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-fad3a6cf-bcd4-4536-bd4e-2ceeee1a5fe8 tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-3bf745a5-90f8-4644-b5ec-3abab4ba596d-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:05 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1" returned: 0 in 0.471s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:05 devstack sudo[90372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1
Apr 21 02:34:05 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:06 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d9e62f23-d398-4e67-897e-049f48189de1" returned: 0 in 0.390s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-quobyte-d9e62f23-d398-4e67-897e-049f48189de1" released by "delete_volume" :: held 0.884s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Created reservations ['bfbf8700-c81e-4ec0-82ea-9d71a9e1c5d5', '13d6b219-5119-4fb2-86e5-bb2f12d069bb', '896d96b3-04b0-4472-afe3-c93e2f773dd8', '120f22a0-86e7-4464-9bc6-8855ebe6af84'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:06 devstack sudo[90375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:34:06 devstack sudo[90375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:06 devstack sudo[90375]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.441s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:34:06 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Deleted volume successfully.
Apr 21 02:34:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-070cf399-274f-4da3-943b-1734b07449ac tempest-CreateVolumesFromImageTest-305653861 None] Lock "cinder-d9e62f23-d398-4e67-897e-049f48189de1-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:16 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:UPDATE=173,cinder:SELECT=117,cinder:INSERT=37,cinder:DELETE=11 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:34:16 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:UPDATE=101,cinder:SELECT=65,cinder:INSERT=31,cinder:DELETE=10 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Flow 'volume_create_manager' (5d67ae32-7e27-4995-953c-08928d09445a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ddedef-e678-4512-9e14-2a7f6ada5314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ddedef-e678-4512-9e14-2a7f6ada5314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1979780115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697d9ec8-7c28-4bb0-b334-18e7936db509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6ea207852040bc802c3c30faad88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:20Z,use_quota=True,user_id='1bf93e4caeb44287b715c4e94d4704b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93a41d7-b5f5-4eb6-84f7-d5050caca100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b93a41d7-b5f5-4eb6-84f7-d5050caca100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bd3379-5136-49ea-bfed-a42f471ca4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bd3379-5136-49ea-bfed-a42f471ca4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697d9ec8-7c28-4bb0-b334-18e7936db509', 'volume_name': 'volume-697d9ec8-7c28-4bb0-b334-18e7936db509', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080f7073-ade9-44f9-b04f-456f3af31ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080f7073-ade9-44f9-b04f-456f3af31ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8892e9-21b7-4fdb-b0b7-0374b3ace183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:20 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Volume 697d9ec8-7c28-4bb0-b334-18e7936db509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697d9ec8-7c28-4bb0-b334-18e7936db509', 'volume_size': 1}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1979780115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=697d9ec8-7c28-4bb0-b334-18e7936db509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6ea207852040bc802c3c30faad88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:20Z,use_quota=True,user_id='1bf93e4caeb44287b715c4e94d4704b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Creating volume 697d9ec8-7c28-4bb0-b334-18e7936db509 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:20 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:20 devstack sudo[90382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 1073741824
Apr 21 02:34:20 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:20 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 1073741824" returned: 0 in 0.533s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:21 devstack sudo[90387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509
Apr 21 02:34:21 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:21 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509" returned: 0 in 0.477s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8892e9-21b7-4fdb-b0b7-0374b3ace183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697d9ec8-7c28-4bb0-b334-18e7936db509', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cdd467-78d3-43cc-aa35-8994b6f4905d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:21 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Volume volume-697d9ec8-7c28-4bb0-b334-18e7936db509 (697d9ec8-7c28-4bb0-b334-18e7936db509): created successfully
Apr 21 02:34:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8cdd467-78d3-43cc-aa35-8994b6f4905d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Flow 'volume_create_manager' (5d67ae32-7e27-4995-953c-08928d09445a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:21 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-002ef853-9097-499f-81f8-965120808d3d tempest-SnapshotDependencyTests-42184412 None] Created volume successfully.
Apr 21 02:34:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] Creating offline snapshot 460db2a2-5fc3-4d2b-a58d-025b357b952d of volume 697d9ec8-7c28-4bb0-b334-18e7936db509 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:34:22 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4564ada-339c-4016-9d5d-90b4df66dfa7]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:22 devstack sudo[90391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509
Apr 21 02:34:22 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:23 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509" returned: 0 in 0.461s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:23 devstack sudo[90396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d 1G
Apr 21 02:34:23 devstack sudo[90396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:23 devstack sudo[90396]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d 1G" returned: 0 in 0.473s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697d9ec8-7c28-4bb0-b334-18e7936db509 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:23 devstack sudo[90401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697d9ec8-7c28-4bb0-b334-18e7936db509 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d
Apr 21 02:34:23 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:24 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697d9ec8-7c28-4bb0-b334-18e7936db509 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d" returned: 0 in 0.430s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:24 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d is being set with open permissions: ugo+rw
Apr 21 02:34:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:24 devstack sudo[90406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d
Apr 21 02:34:24 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:24 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d" returned: 0 in 0.395s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:24 devstack sudo[90409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.info
Apr 21 02:34:24 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:24 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.info" returned: 0 in 0.412s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:24 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.info is being set with open permissions: ugo+rw
Apr 21 02:34:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:24 devstack sudo[90412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.info
Apr 21 02:34:24 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:25 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.info" returned: 0 in 0.414s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:25 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c06024e3-3f82-470e-b9fd-dedc5f02fa89 tempest-SnapshotDependencyTests-42184412 None] Create snapshot completed successfully
Apr 21 02:34:25 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Flow 'volume_create_manager' (abba7da6-1158-4055-95f2-5fd4829b4800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71feae5f-a2e0-4add-b2d1-062b1f607862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71feae5f-a2e0-4add-b2d1-062b1f607862) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0298ea-d698-4154-a9aa-f6dc39da208f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f6ea207852040bc802c3c30faad88e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=460db2a2-5fc3-4d2b-a58d-025b357b952d,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:26Z,use_quota=True,user_id='1bf93e4caeb44287b715c4e94d4704b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe1ceb4-f9cc-4417-bdb1-4b512f50dd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe1ceb4-f9cc-4417-bdb1-4b512f50dd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43285112-8b72-4ba1-ba10-f53f726dc21b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43285112-8b72-4ba1-ba10-f53f726dc21b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5a0298ea-d698-4154-a9aa-f6dc39da208f', 'volume_name': 'volume-5a0298ea-d698-4154-a9aa-f6dc39da208f', 'volume_size': 1, 'snapshot_id': '460db2a2-5fc3-4d2b-a58d-025b357b952d'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad512e0e-fb8e-410d-a2c9-6918f59c0b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad512e0e-fb8e-410d-a2c9-6918f59c0b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c8b746-523a-4146-bec6-ae2c64dcaa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:26 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Volume 5a0298ea-d698-4154-a9aa-f6dc39da208f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5a0298ea-d698-4154-a9aa-f6dc39da208f', 'volume_size': 1, 'snapshot_id': '460db2a2-5fc3-4d2b-a58d-025b357b952d'}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "cinder-quobyte-460db2a2-5fc3-4d2b-a58d-025b357b952d-5a0298ea-d698-4154-a9aa-f6dc39da208f" by "_create_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-460db2a2-5fc3-4d2b-a58d-025b357b952d-5a0298ea-d698-4154-a9aa-f6dc39da208f" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Creating volume 5a0298ea-d698-4154-a9aa-f6dc39da208f from snapshot 460db2a2-5fc3-4d2b-a58d-025b357b952d {{(pid=82686) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "cinder-quobyte-5a0298ea-d698-4154-a9aa-f6dc39da208f" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-5a0298ea-d698-4154-a9aa-f6dc39da208f" acquired by "_copy_volume_from_snapshot" :: waited 0.005s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] snapshot: 460db2a2-5fc3-4d2b-a58d-025b357b952d, volume: 5a0298ea-d698-4154-a9aa-f6dc39da208f,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f5fb9e-d9c3-4d1d-91cd-bc42840e512a]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:26 devstack sudo[90415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d
Apr 21 02:34:26 devstack sudo[90415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:26 devstack sudo[90415]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d" returned: 0 in 0.456s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-697d9ec8-7c28-4bb0-b334-18e7936db509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f702ae-e1a0-4f58-8a9d-ae0d6f5d5c83]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:26 devstack sudo[90420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509
Apr 21 02:34:26 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:27 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509" returned: 0 in 0.498s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:27 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:34:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:27 devstack sudo[90425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f
Apr 21 02:34:27 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:29 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f" returned: 0 in 1.951s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:29 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[4612eef2-8747-4024-9cf0-d04aa3acbbf4]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:29 devstack sudo[90437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509
Apr 21 02:34:29 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:29 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509" returned: 0 in 0.602s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:29 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:34:29 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Converted 1024.00 MB image at 524.64 MB/s
Apr 21 02:34:29 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f is being set with open permissions: ugo+rw
Apr 21 02:34:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:29 devstack sudo[90442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f
Apr 21 02:34:29 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:30 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f" returned: 0 in 0.403s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-5a0298ea-d698-4154-a9aa-f6dc39da208f" released by "_copy_volume_from_snapshot" :: held 3.959s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-460db2a2-5fc3-4d2b-a58d-025b357b952d-5a0298ea-d698-4154-a9aa-f6dc39da208f" released by "_create_volume_from_snapshot" :: held 3.973s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.980s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63c8b746-523a-4146-bec6-ae2c64dcaa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0298ea-d698-4154-a9aa-f6dc39da208f', 'volume_size': 1, 'snapshot_id': '460db2a2-5fc3-4d2b-a58d-025b357b952d'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd74d048-1dcf-4127-8cb1-93690f6a94e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:30 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Volume volume-5a0298ea-d698-4154-a9aa-f6dc39da208f (5a0298ea-d698-4154-a9aa-f6dc39da208f): created successfully
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd74d048-1dcf-4127-8cb1-93690f6a94e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Flow 'volume_create_manager' (abba7da6-1158-4055-95f2-5fd4829b4800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:30 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9c8b2ff6-b191-4476-aa5f-cabbc8b8dea2 tempest-SnapshotDependencyTests-42184412 None] Created volume successfully.
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "cinder-460db2a2-5fc3-4d2b-a58d-025b357b952d-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-460db2a2-5fc3-4d2b-a58d-025b357b952d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "cinder-quobyte-697d9ec8-7c28-4bb0-b334-18e7936db509" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-697d9ec8-7c28-4bb0-b334-18e7936db509" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "cinder-quobyte-460db2a2-5fc3-4d2b-a58d-025b357b952d" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-460db2a2-5fc3-4d2b-a58d-025b357b952d" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Deleting offline snapshot 460db2a2-5fc3-4d2b-a58d-025b357b952d of volume 697d9ec8-7c28-4bb0-b334-18e7936db509 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] snapshot_file for this snap is: volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ee4b7e-2a26-40b4-bb63-c071a76ea4d6]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:30 devstack sudo[90445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d
Apr 21 02:34:30 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:30 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d" returned: 0 in 0.469s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-697d9ec8-7c28-4bb0-b334-18e7936db509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5541d79-7c75-4f40-a476-122c3f945055]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:30 devstack sudo[90450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509
Apr 21 02:34:30 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:31 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509" returned: 0 in 0.483s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:31 devstack sudo[90455]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d
Apr 21 02:34:31 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:31 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d" returned: 0 in 0.436s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:31 devstack sudo[90461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d
Apr 21 02:34:31 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:32 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509.460db2a2-5fc3-4d2b-a58d-025b357b952d" returned: 0 in 0.396s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-460db2a2-5fc3-4d2b-a58d-025b357b952d" released by "_delete_snapshot" :: held 1.835s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-697d9ec8-7c28-4bb0-b334-18e7936db509" released by "delete_snapshot" :: held 1.849s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Created reservations ['5dd04a37-f167-43c8-8910-a7ee050e0b69', 'cd681ea7-fd2d-4072-bded-c373ff51bc75', '1db485b9-89c1-4186-8661-c9843c1d1308', 'dcf2eba4-adcc-42fa-aca1-262de75f8090'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:34:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Delete snapshot completed successfully.
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bc80a1bb-748a-41c5-a5d6-eb7e2957f13b tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-460db2a2-5fc3-4d2b-a58d-025b357b952d-delete_snapshot" released by "delete_snapshot" :: held 1.925s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "cinder-697d9ec8-7c28-4bb0-b334-18e7936db509-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-697d9ec8-7c28-4bb0-b334-18e7936db509-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "cinder-quobyte-697d9ec8-7c28-4bb0-b334-18e7936db509" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-697d9ec8-7c28-4bb0-b334-18e7936db509" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8408f2ad-d937-40f4-b480-0811687998c5]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:32 devstack sudo[90464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509
Apr 21 02:34:32 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:32 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509" returned: 0 in 0.464s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:32 devstack sudo[90469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509
Apr 21 02:34:32 devstack sudo[90469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:33 devstack sudo[90469]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-697d9ec8-7c28-4bb0-b334-18e7936db509" returned: 0 in 0.394s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-697d9ec8-7c28-4bb0-b334-18e7936db509" released by "delete_volume" :: held 0.894s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Created reservations ['44c326c2-e6d8-48e0-a7ae-1304da4edf95', '702c75d9-67c2-4107-901b-9ed340e03ea3', '29baf619-e9d9-496e-9338-0ca3a5657bea', 'd8b2a2dc-1ef0-45e1-a88b-004897783494'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:33 devstack sudo[90472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:34:33 devstack sudo[90472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "cinder-5a0298ea-d698-4154-a9aa-f6dc39da208f-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-5a0298ea-d698-4154-a9aa-f6dc39da208f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "cinder-quobyte-5a0298ea-d698-4154-a9aa-f6dc39da208f" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-5a0298ea-d698-4154-a9aa-f6dc39da208f" acquired by "delete_volume" :: waited 0.019s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbf0504-8a82-4d5e-84f4-9270f452d6d9]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:33 devstack sudo[90474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f
Apr 21 02:34:33 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:33 devstack sudo[90472]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.440s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:34:33 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Deleted volume successfully.
Apr 21 02:34:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-058f1aca-a7bb-4fc6-a432-00ad7b29db37 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-697d9ec8-7c28-4bb0-b334-18e7936db509-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:34 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f" returned: 0 in 0.463s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:34 devstack sudo[90480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f
Apr 21 02:34:34 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:34 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-5a0298ea-d698-4154-a9aa-f6dc39da208f" returned: 0 in 0.397s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-quobyte-5a0298ea-d698-4154-a9aa-f6dc39da208f" released by "delete_volume" :: held 0.879s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Created reservations ['09e971b9-caf0-47e1-9e05-d8f62253807f', 'f38e18fa-2feb-4b20-a691-932b8a1d1455', '4b2dfaba-a463-4482-9589-afe67ca06eeb', 'bdeccf88-91be-41eb-9f63-1fe354aff35a'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:34 devstack sudo[90483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:34:34 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:34 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.428s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:34:34 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Deleted volume successfully.
Apr 21 02:34:34 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b7c44aa7-44e0-4a7c-b53c-cedd693fff90 tempest-SnapshotDependencyTests-42184412 None] Lock "cinder-5a0298ea-d698-4154-a9aa-f6dc39da208f-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:44 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=23,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=1 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:34:44 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:UPDATE=27,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=4 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (c39d7960-ba3f-41be-8b97-3359bb460384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee48eee-57be-455e-8150-ec2fd8cbd6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ee48eee-57be-455e-8150-ec2fd8cbd6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2077717021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2818fc-50f2-4563-a48a-93416e8ede4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:46Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1d2ec6-c8ca-48a6-b2b7-3d0f6bae58b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1d2ec6-c8ca-48a6-b2b7-3d0f6bae58b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104d9e2f-6696-438f-83c8-88cbb2aeaf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (104d9e2f-6696-438f-83c8-88cbb2aeaf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf2818fc-50f2-4563-a48a-93416e8ede4b', 'volume_name': 'volume-cf2818fc-50f2-4563-a48a-93416e8ede4b', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a83d01-0789-46ce-979a-d84794689322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a83d01-0789-46ce-979a-d84794689322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878bfb01-3be0-42a8-a592-cd74aa391fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume cf2818fc-50f2-4563-a48a-93416e8ede4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf2818fc-50f2-4563-a48a-93416e8ede4b', 'volume_size': 1}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2077717021',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf2818fc-50f2-4563-a48a-93416e8ede4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:46Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Creating volume cf2818fc-50f2-4563-a48a-93416e8ede4b {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:46 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:46 devstack sudo[90532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b 1073741824
Apr 21 02:34:46 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Flow 'volume_create_manager' (198827d9-9315-4821-849d-12ea20e65687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b6d3b9-8f9d-4357-9856-1b9eee5ab886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64b6d3b9-8f9d-4357-9856-1b9eee5ab886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-457699045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e31b59a-219b-484c-8343-11ecf9852870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5cde72131e4b27aacb27d473103b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:46Z,use_quota=True,user_id='7369bd86dc1e49949fedbdf0ec643c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac43c021-d4bc-4de2-83a8-5a559de6c795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac43c021-d4bc-4de2-83a8-5a559de6c795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf53d78-91be-4abe-aeea-c2b1f7c0a72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbf53d78-91be-4abe-aeea-c2b1f7c0a72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e31b59a-219b-484c-8343-11ecf9852870', 'volume_name': 'volume-7e31b59a-219b-484c-8343-11ecf9852870', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db5fa3a-52b0-4dc7-be56-0c51300a6e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db5fa3a-52b0-4dc7-be56-0c51300a6e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e773c7a-a82f-409a-b468-da383dfbc21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Volume 7e31b59a-219b-484c-8343-11ecf9852870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e31b59a-219b-484c-8343-11ecf9852870', 'volume_size': 1}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (ecaf0c60-0edb-4d65-8428-25fb7d36b26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617fa6e4-204c-497c-9adc-268705870135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617fa6e4-204c-497c-9adc-268705870135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1841795094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44abc718-51b1-4f85-8965-8082159aa63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:47Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e0cab9-00a5-47f3-88f2-4446c13777bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19e0cab9-00a5-47f3-88f2-4446c13777bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371e08bd-da80-49b8-aab0-d1966904c03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371e08bd-da80-49b8-aab0-d1966904c03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44abc718-51b1-4f85-8965-8082159aa63c', 'volume_name': 'volume-44abc718-51b1-4f85-8965-8082159aa63c', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf05f79b-8b04-4be4-87ec-4121a3707fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf05f79b-8b04-4be4-87ec-4121a3707fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa645e43-11a3-4820-a813-a20af7cdcd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume 44abc718-51b1-4f85-8965-8082159aa63c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44abc718-51b1-4f85-8965-8082159aa63c', 'volume_size': 1}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Flow 'volume_create_manager' (a504c7cf-7451-4611-bdbc-7251299a197e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad36d3d3-023e-422e-b790-faa8e5339086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad36d3d3-023e-422e-b790-faa8e5339086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-113760058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e48c70-3d51-4c55-b39b-e117a04e927d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798f1e49d824dbd9cf430d457c70743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:47Z,use_quota=True,user_id='74b3bb8323ee4dae9e42c8d8c36b8e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2783a86d-8d08-4259-b7bd-305c9ef933be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2783a86d-8d08-4259-b7bd-305c9ef933be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c512c409-2881-4226-9262-653cd6077bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c512c409-2881-4226-9262-653cd6077bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85e48c70-3d51-4c55-b39b-e117a04e927d', 'volume_name': 'volume-85e48c70-3d51-4c55-b39b-e117a04e927d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02b8791-6cef-4948-a4fd-880b9256f876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c02b8791-6cef-4948-a4fd-880b9256f876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2978e9-2783-461f-a957-30e0041134fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Volume 85e48c70-3d51-4c55-b39b-e117a04e927d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85e48c70-3d51-4c55-b39b-e117a04e927d', 'volume_size': 1}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Flow 'volume_create_manager' (13988d04-95bf-4995-9837-1d03f91bce7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ba4da1-5194-4a6b-911d-1013f6260179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ba4da1-5194-4a6b-911d-1013f6260179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1480032920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa31b9b-7d3b-4526-8d8e-317d5789d5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5cde72131e4b27aacb27d473103b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:47Z,use_quota=True,user_id='7369bd86dc1e49949fedbdf0ec643c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:46 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab6a133-2944-4240-9c4b-427a2b92ada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab6a133-2944-4240-9c4b-427a2b92ada7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f22804-47da-48df-909d-0d40fa8e0dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f22804-47da-48df-909d-0d40fa8e0dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa31b9b-7d3b-4526-8d8e-317d5789d5ca', 'volume_name': 'volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcb2ce5-08f8-47cf-9a7c-70f5ec694da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abcb2ce5-08f8-47cf-9a7c-70f5ec694da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15097108-e34e-42c3-a2e7-80ac3513bbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Volume caa31b9b-7d3b-4526-8d8e-317d5789d5ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca', 'volume_size': 1}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:47 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b 1073741824" returned: 0 in 0.536s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:47 devstack sudo[90537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b
Apr 21 02:34:47 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Flow 'volume_create_manager' (16dcf630-8a2c-45b9-b543-43f5c9d0ca16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a746fd86-abd5-4e55-b541-2a7a2a6c83ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a746fd86-abd5-4e55-b541-2a7a2a6c83ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-683705671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5cde72131e4b27aacb27d473103b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:47Z,use_quota=True,user_id='7369bd86dc1e49949fedbdf0ec643c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ca7f99-624e-40c2-8069-a9b0910561c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3ca7f99-624e-40c2-8069-a9b0910561c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bc59d8-271f-425c-9ef1-a558f02971bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46bc59d8-271f-425c-9ef1-a558f02971bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f', 'volume_name': 'volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b4c159-3d79-4fbf-8950-4da4d9a92bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29b4c159-3d79-4fbf-8950-4da4d9a92bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652b6f7c-fbe9-4ee3-9f99-db1126599dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Volume efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f', 'volume_size': 1}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Flow 'volume_create_manager' (7c3c4ac1-0b67-4ca6-ad07-2d01c0c71779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336ef0a0-e9bf-4ea2-8e33-085a7b6297ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (336ef0a0-e9bf-4ea2-8e33-085a7b6297ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-220080277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5cde72131e4b27aacb27d473103b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:47Z,use_quota=True,user_id='7369bd86dc1e49949fedbdf0ec643c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a70183b-626b-4ea9-9c93-e85052a7497a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a70183b-626b-4ea9-9c93-e85052a7497a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70bce20-7fb1-49cc-8f63-24424fc2699f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70bce20-7fb1-49cc-8f63-24424fc2699f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c', 'volume_name': 'volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5a91c6-97c6-478a-b45d-b6c59c5e423c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b5a91c6-97c6-478a-b45d-b6c59c5e423c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac29ed2f-f8f4-4074-8434-585afcdef081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Volume 30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c', 'volume_size': 1}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:47 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Flow 'volume_create_manager' (d356bfb8-1af0-4e00-8900-c53291499a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfd79b6-0a0f-4eec-8276-f0c8ddba487f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b" returned: 0 in 0.487s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.954s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-457699045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e31b59a-219b-484c-8343-11ecf9852870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5cde72131e4b27aacb27d473103b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:46Z,use_quota=True,user_id='7369bd86dc1e49949fedbdf0ec643c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Creating volume 7e31b59a-219b-484c-8343-11ecf9852870 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:47 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:47 devstack sudo[90540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870 1073741824
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bfd79b6-0a0f-4eec-8276-f0c8ddba487f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1259148827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0d417d-c1d4-4928-8052-8e082daaa51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5cde72131e4b27aacb27d473103b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:48Z,use_quota=True,user_id='7369bd86dc1e49949fedbdf0ec643c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585fc435-1ca0-40a9-ba54-b9ff2f6c8f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (585fc435-1ca0-40a9-ba54-b9ff2f6c8f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96cf4af1-4eb2-40df-8428-10ada51bc1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96cf4af1-4eb2-40df-8428-10ada51bc1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0d417d-c1d4-4928-8052-8e082daaa51f', 'volume_name': 'volume-2a0d417d-c1d4-4928-8052-8e082daaa51f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b15409b-9d62-46ba-8d8c-8bab3b54e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b15409b-9d62-46ba-8d8c-8bab3b54e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfacf571-ab6a-4ae3-8617-fbea02955bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Volume 2a0d417d-c1d4-4928-8052-8e082daaa51f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0d417d-c1d4-4928-8052-8e082daaa51f', 'volume_size': 1}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878bfb01-3be0-42a8-a592-cd74aa391fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf2818fc-50f2-4563-a48a-93416e8ede4b', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770ebf13-2f10-4dd4-bffa-d239dfa63f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:47 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume volume-cf2818fc-50f2-4563-a48a-93416e8ede4b (cf2818fc-50f2-4563-a48a-93416e8ede4b): created successfully
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770ebf13-2f10-4dd4-bffa-d239dfa63f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (c39d7960-ba3f-41be-8b97-3359bb460384) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:47 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-5f8fe4fe-149b-4d45-92c6-ce78c9c4e435 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created volume successfully.
Apr 21 02:34:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:48 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870 1073741824" returned: 0 in 0.487s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:48 devstack sudo[90545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870
Apr 21 02:34:48 devstack sudo[90545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:48 devstack sudo[90545]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870" returned: 0 in 0.402s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.681s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1841795094',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44abc718-51b1-4f85-8965-8082159aa63c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:47Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Creating volume 44abc718-51b1-4f85-8965-8082159aa63c {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:48 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e773c7a-a82f-409a-b468-da383dfbc21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e31b59a-219b-484c-8343-11ecf9852870', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:48 devstack sudo[90548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c 1073741824
Apr 21 02:34:48 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce43e3cf-d383-40d0-bcd1-478c25ae1763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:48 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Volume volume-7e31b59a-219b-484c-8343-11ecf9852870 (7e31b59a-219b-484c-8343-11ecf9852870): created successfully
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce43e3cf-d383-40d0-bcd1-478c25ae1763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:48 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Flow 'volume_create_manager' (198827d9-9315-4821-849d-12ea20e65687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e022f3d0-e5ba-44d8-96ad-d0f3a38029e3 tempest-CreateVolumesFromImageTest-625486566 None] Created volume successfully.
Apr 21 02:34:49 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c 1073741824" returned: 0 in 0.487s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:49 devstack sudo[90553]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c
Apr 21 02:34:49 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:49 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c" returned: 0 in 0.410s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.506s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-113760058',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85e48c70-3d51-4c55-b39b-e117a04e927d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798f1e49d824dbd9cf430d457c70743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:47Z,use_quota=True,user_id='74b3bb8323ee4dae9e42c8d8c36b8e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Creating volume 85e48c70-3d51-4c55-b39b-e117a04e927d {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:49 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa645e43-11a3-4820-a813-a20af7cdcd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44abc718-51b1-4f85-8965-8082159aa63c', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4a3aed-6033-44cb-b0a7-513a5de16770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:49 devstack sudo[90556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d 1073741824
Apr 21 02:34:49 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:49 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume volume-44abc718-51b1-4f85-8965-8082159aa63c (44abc718-51b1-4f85-8965-8082159aa63c): created successfully
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f4a3aed-6033-44cb-b0a7-513a5de16770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (ecaf0c60-0edb-4d65-8428-25fb7d36b26a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:49 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e9ee97bb-3507-4f29-8a8b-bf867403652b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created volume successfully.
Apr 21 02:34:49 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d 1073741824" returned: 0 in 0.505s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:49 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:49 devstack sudo[90561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d
Apr 21 02:34:49 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (7ada90ae-cadb-40c9-874b-b3c4db170381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f23527c-23ef-452f-97c5-0f3ead816021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f23527c-23ef-452f-97c5-0f3ead816021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-163933398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f4a67c-7ea6-47e5-b253-7d13e3fd9e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:50Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102c1bf9-914b-4a3f-9bbb-f0706c93fe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102c1bf9-914b-4a3f-9bbb-f0706c93fe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e6d873-d48b-4f33-8be8-b1723e9e3a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e6d873-d48b-4f33-8be8-b1723e9e3a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f4a67c-7ea6-47e5-b253-7d13e3fd9e46', 'volume_name': 'volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd12da99-d279-46a6-ac9a-c1f33cc2c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd12da99-d279-46a6-ac9a-c1f33cc2c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce5ff2f-7865-40e4-9eba-81e515d39514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume 37f4a67c-7ea6-47e5-b253-7d13e3fd9e46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46', 'volume_size': 1}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (4fc3e6cf-cf4f-4f4b-ae26-e3408d19ae17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352e9519-a173-4bd8-a3d1-cae2f29469aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (352e9519-a173-4bd8-a3d1-cae2f29469aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245122859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d764a6f1-9a0c-4d5e-aa60-f8050054ec99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:50Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3906753d-6cf5-4ad3-90f4-f754d47891d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3906753d-6cf5-4ad3-90f4-f754d47891d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0b95b5-cbb8-4ad6-977c-24045ac103b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0b95b5-cbb8-4ad6-977c-24045ac103b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd764a6f1-9a0c-4d5e-aa60-f8050054ec99', 'volume_name': 'volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040eb7b6-4051-4283-be30-82f9cef3e483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (040eb7b6-4051-4283-be30-82f9cef3e483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9c0a70-746b-40aa-910e-3b517e19d042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume d764a6f1-9a0c-4d5e-aa60-f8050054ec99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99', 'volume_size': 1}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:50 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d" returned: 0 in 0.460s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.412s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1480032920',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa31b9b-7d3b-4526-8d8e-317d5789d5ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5cde72131e4b27aacb27d473103b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:47Z,use_quota=True,user_id='7369bd86dc1e49949fedbdf0ec643c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Creating volume caa31b9b-7d3b-4526-8d8e-317d5789d5ca {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:50 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c2978e9-2783-461f-a957-30e0041134fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85e48c70-3d51-4c55-b39b-e117a04e927d', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126ff26e-9983-4c1d-8c14-185c15f19e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack sudo[90565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca 1073741824
Apr 21 02:34:50 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:50 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Volume volume-85e48c70-3d51-4c55-b39b-e117a04e927d (85e48c70-3d51-4c55-b39b-e117a04e927d): created successfully
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (126ff26e-9983-4c1d-8c14-185c15f19e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Flow 'volume_create_manager' (a504c7cf-7451-4611-bdbc-7251299a197e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:50 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-a970e23e-3b9f-4559-805e-90beb1fc770c tempest-VolumeDependencyTests-500811021 None] Created volume successfully.
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (f163c7af-b593-47b4-93ca-546a8e53b277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701c857b-0ba7-42ac-854b-fea21d7c593f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (701c857b-0ba7-42ac-854b-fea21d7c593f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-790323600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962c14dc-9533-439b-8480-222a86f9fce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:50Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1edb13-3e54-4e07-a64c-c167b25c3ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1edb13-3e54-4e07-a64c-c167b25c3ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae69ebf2-8c7f-41be-8ed8-c28873628c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae69ebf2-8c7f-41be-8ed8-c28873628c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '962c14dc-9533-439b-8480-222a86f9fce9', 'volume_name': 'volume-962c14dc-9533-439b-8480-222a86f9fce9', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a466b12c-1dcf-46ed-af69-b2cd57bfa713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a466b12c-1dcf-46ed-af69-b2cd57bfa713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd36873-1ecb-4db5-83e1-8a11428dd2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume 962c14dc-9533-439b-8480-222a86f9fce9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-962c14dc-9533-439b-8480-222a86f9fce9', 'volume_size': 1}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (59fe56d4-9f83-46fa-9e4e-96e4f777e4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43480f5c-9259-4b6e-a01b-84c57da376cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43480f5c-9259-4b6e-a01b-84c57da376cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-818670329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dc8463-25c4-4b5f-88c9-bf5b6243f615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:51Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a2ef0f-5ea0-4813-909a-18629db39cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a2ef0f-5ea0-4813-909a-18629db39cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d755f35-f5ec-4b83-ba9e-6ad51f44d579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d755f35-f5ec-4b83-ba9e-6ad51f44d579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54dc8463-25c4-4b5f-88c9-bf5b6243f615', 'volume_name': 'volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372ba065-c6ae-4299-8da9-419ed6c05227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372ba065-c6ae-4299-8da9-419ed6c05227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee66d7b0-b65c-4f78-bd92-4705fd42753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume 54dc8463-25c4-4b5f-88c9-bf5b6243f615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615', 'volume_size': 1}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (22d9d940-95c1-42f4-9305-897c02944c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eca57b2-dc14-4041-b45e-8ce0b1c4a0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eca57b2-dc14-4041-b45e-8ce0b1c4a0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-335760393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bd869a-c469-4a97-afc6-6086f3efdfa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:51Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da63817-e917-45e1-95f7-9d2358d3cba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da63817-e917-45e1-95f7-9d2358d3cba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccdc684-5bcf-4a1a-a716-cea7da4632bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ccdc684-5bcf-4a1a-a716-cea7da4632bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10bd869a-c469-4a97-afc6-6086f3efdfa0', 'volume_name': 'volume-10bd869a-c469-4a97-afc6-6086f3efdfa0', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b9d88b-94e6-467c-a298-2bc9ce69757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0b9d88b-94e6-467c-a298-2bc9ce69757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a4101b-b113-43ca-b462-95cec33d7f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:50 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume 10bd869a-c469-4a97-afc6-6086f3efdfa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10bd869a-c469-4a97-afc6-6086f3efdfa0', 'volume_size': 1}
Apr 21 02:34:50 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:51 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca 1073741824" returned: 0 in 0.565s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:51 devstack sudo[90576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca
Apr 21 02:34:51 devstack sudo[90576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:51 devstack sudo[90576]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca" returned: 0 in 0.449s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.265s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-683705671',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5cde72131e4b27aacb27d473103b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:47Z,use_quota=True,user_id='7369bd86dc1e49949fedbdf0ec643c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Creating volume efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:51 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15097108-e34e-42c3-a2e7-80ac3513bbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524699f9-d0b7-4aa5-93bc-1f1181f4ae29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:51 devstack sudo[90580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f 1073741824
Apr 21 02:34:51 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:51 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Volume volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca (caa31b9b-7d3b-4526-8d8e-317d5789d5ca): created successfully
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (524699f9-d0b7-4aa5-93bc-1f1181f4ae29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Flow 'volume_create_manager' (13988d04-95bf-4995-9837-1d03f91bce7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:51 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1f0edfed-9e15-4568-a20f-21f2150c9989 tempest-CreateVolumesFromImageTest-625486566 None] Created volume successfully.
Apr 21 02:34:51 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:51 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f 1073741824" returned: 0 in 0.496s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:52 devstack sudo[90585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f
Apr 21 02:34:52 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:52 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f" returned: 0 in 0.418s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.982s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-220080277',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5cde72131e4b27aacb27d473103b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:47Z,use_quota=True,user_id='7369bd86dc1e49949fedbdf0ec643c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Creating volume 30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:52 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (652b6f7c-fbe9-4ee3-9f99-db1126599dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:52 devstack sudo[90588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c 1073741824
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe7ae6b-1b9a-476e-bbf8-b03f604c7024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:52 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:52 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Volume volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f (efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f): created successfully
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebe7ae6b-1b9a-476e-bbf8-b03f604c7024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Flow 'volume_create_manager' (16dcf630-8a2c-45b9-b543-43f5c9d0ca16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:52 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-38f6412a-d9d0-4cd0-8e45-af9c537207af tempest-CreateVolumesFromImageTest-625486566 None] Created volume successfully.
Apr 21 02:34:52 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c 1073741824" returned: 0 in 0.510s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:52 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:52 devstack sudo[90593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c
Apr 21 02:34:52 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:53 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c" returned: 0 in 0.412s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.724s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1259148827',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0d417d-c1d4-4928-8052-8e082daaa51f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a5cde72131e4b27aacb27d473103b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:48Z,use_quota=True,user_id='7369bd86dc1e49949fedbdf0ec643c3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Creating volume 2a0d417d-c1d4-4928-8052-8e082daaa51f {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:53 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac29ed2f-f8f4-4074-8434-585afcdef081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69330596-6fa5-4770-8fb9-f9ff2acd88bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:53 devstack sudo[90596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f 1073741824
Apr 21 02:34:53 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:53 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Volume volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c (30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c): created successfully
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69330596-6fa5-4770-8fb9-f9ff2acd88bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Flow 'volume_create_manager' (7c3c4ac1-0b67-4ca6-ad07-2d01c0c71779) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:53 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-0eb7764b-3508-4092-a8b2-89767486d033 tempest-CreateVolumesFromImageTest-625486566 None] Created volume successfully.
Apr 21 02:34:53 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f 1073741824" returned: 0 in 0.476s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:53 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:53 devstack sudo[90601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f
Apr 21 02:34:53 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:54 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f" returned: 0 in 0.401s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.373s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfacf571-ab6a-4ae3-8617-fbea02955bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0d417d-c1d4-4928-8052-8e082daaa51f', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12769ec-1a35-4939-844f-7156ae79ae0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] Creating offline snapshot f990bb5b-c061-459f-b5d6-561e58067a46 of volume cf2818fc-50f2-4563-a48a-93416e8ede4b {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:34:54 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Volume volume-2a0d417d-c1d4-4928-8052-8e082daaa51f (2a0d417d-c1d4-4928-8052-8e082daaa51f): created successfully
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12769ec-1a35-4939-844f-7156ae79ae0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Flow 'volume_create_manager' (d356bfb8-1af0-4e00-8900-c53291499a5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09ca159-acfb-4ee4-a5b8-71e57bd63ece]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:54 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d6ca47d4-7395-4bac-ab96-4d554c86e9af tempest-CreateVolumesFromImageTest-625486566 None] Created volume successfully.
Apr 21 02:34:54 devstack sudo[90604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b
Apr 21 02:34:54 devstack sudo[90604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:54 devstack sudo[90604]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b" returned: 0 in 0.478s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:54 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:54 devstack sudo[90609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46 1G
Apr 21 02:34:54 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "cinder-2a0d417d-c1d4-4928-8052-8e082daaa51f-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-2a0d417d-c1d4-4928-8052-8e082daaa51f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "cinder-quobyte-2a0d417d-c1d4-4928-8052-8e082daaa51f" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-quobyte-2a0d417d-c1d4-4928-8052-8e082daaa51f" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d8bab6-73ed-42bc-ba60-5a15b186c1f5]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:55 devstack sudo[90614]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f
Apr 21 02:34:55 devstack sudo[90614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:55 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46 1G" returned: 0 in 0.504s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2818fc-50f2-4563-a48a-93416e8ede4b -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:55 devstack sudo[90616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2818fc-50f2-4563-a48a-93416e8ede4b -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46
Apr 21 02:34:55 devstack sudo[90616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:55 devstack sudo[90614]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f" returned: 0 in 0.472s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:55 devstack sudo[90624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f
Apr 21 02:34:55 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:55 devstack sudo[90616]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf2818fc-50f2-4563-a48a-93416e8ede4b -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46" returned: 0 in 0.410s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:55 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46 is being set with open permissions: ugo+rw
Apr 21 02:34:55 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:55 devstack sudo[90626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46
Apr 21 02:34:55 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:56 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2a0d417d-c1d4-4928-8052-8e082daaa51f" returned: 0 in 0.401s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-quobyte-2a0d417d-c1d4-4928-8052-8e082daaa51f" released by "delete_volume" :: held 0.897s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:56 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46" returned: 0 in 0.399s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Created reservations ['04686bc8-2adc-4677-bd7d-299aacf0a6a3', '7bc62984-69a5-47c7-ac94-15f993d62864', 'ce41d0bf-08a6-43e2-b377-ecfc8a6541dd', 'e035b9a4-401a-414d-8910-9ba3311bbc4b'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:56 devstack sudo[90630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.info
Apr 21 02:34:56 devstack sudo[90630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:56 devstack sudo[90632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:34:56 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "cinder-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "cinder-quobyte-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-quobyte-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ddbc03-7d83-4e1c-821c-30f013f8e136]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:56 devstack sudo[90634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c
Apr 21 02:34:56 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:56 devstack sudo[90630]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.info" returned: 0 in 0.429s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:56 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.info is being set with open permissions: ugo+rw
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:56 devstack sudo[90638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.info
Apr 21 02:34:56 devstack sudo[90638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:56 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.456s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:34:56 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Deleted volume successfully.
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-22f1df74-ce22-407c-a67b-ad22f6d9d83f tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-2a0d417d-c1d4-4928-8052-8e082daaa51f-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:56 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c" returned: 0 in 0.473s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:56 devstack sudo[90643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c
Apr 21 02:34:56 devstack sudo[90643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:56 devstack sudo[90638]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.info" returned: 0 in 0.412s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.709s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.772s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-163933398',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f4a67c-7ea6-47e5-b253-7d13e3fd9e46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:50Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Creating volume 37f4a67c-7ea6-47e5-b253-7d13e3fd9e46 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:56 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:57 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:57 devstack sudo[90646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46 1073741824
Apr 21 02:34:57 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:57 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-89bc0f8d-abe0-4556-a5ce-ce490c4b423b tempest-CreateVolumesFromSnapshotTest-1187722849 None] Create snapshot completed successfully
Apr 21 02:34:57 devstack sudo[90643]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c" returned: 0 in 0.424s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-quobyte-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c" released by "delete_volume" :: held 0.920s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Created reservations ['bf440950-e869-4542-bdc3-f8e1d6703c28', 'c5ad4f94-94d0-488f-a9bc-726ff144cb0a', 'd8a325c4-85c2-44ac-8d49-08b4825d0d41', 'cdb44bd4-32f5-4ba5-bf54-4ef669adccbe'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:57 devstack sudo[90649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:34:57 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "cinder-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "cinder-quobyte-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-quobyte-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be817c7-db1a-48d6-a3e2-22e5bdecc332]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (705180d9-c7e1-4485-ae50-b0507d8bf8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5576e418-a2fe-4bdf-b4c0-e0a66f200a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5576e418-a2fe-4bdf-b4c0-e0a66f200a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861533485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee78dee4-3adb-46e3-946f-5c47496a1ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:57Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5f1e9a-3d59-48af-998c-36249c53d5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b5f1e9a-3d59-48af-998c-36249c53d5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6913e88d-8614-4851-a755-30df8d69ce26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6913e88d-8614-4851-a755-30df8d69ce26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee78dee4-3adb-46e3-946f-5c47496a1ac2', 'volume_name': 'volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd536be-b8c1-4d8c-aa57-068104b9c95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbd536be-b8c1-4d8c-aa57-068104b9c95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8989833f-192e-4f17-a3ed-47bf4c8df6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume ee78dee4-3adb-46e3-946f-5c47496a1ac2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2', 'volume_size': 1}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46 1073741824" returned: 0 in 0.636s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:57 devstack sudo[90654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f
Apr 21 02:34:57 devstack sudo[90654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (b1d01870-a6a0-45e8-97db-4aa281feb19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e99b652-6fb0-4bae-a7ed-5cf2fb664b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e99b652-6fb0-4bae-a7ed-5cf2fb664b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1818770794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6f259c-c5c5-47a0-abc9-13c32bd4c159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:58Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742f47a6-85dd-4dca-9f32-0312d26075c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (742f47a6-85dd-4dca-9f32-0312d26075c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3dc3e00-90a2-42ff-af96-d522fb8d90b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack sudo[90656]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3dc3e00-90a2-42ff-af96-d522fb8d90b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6f259c-c5c5-47a0-abc9-13c32bd4c159', 'volume_name': 'volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack sudo[90656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdeff24-982c-4148-8d13-c23d7a3a1117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abdeff24-982c-4148-8d13-c23d7a3a1117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65087dd-1079-454e-b383-dfe7a36b6b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume 4d6f259c-c5c5-47a0-abc9-13c32bd4c159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159', 'volume_size': 1}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:57 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (0cfa0be4-074d-4713-bf49-8ea1d7db099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c80d41e-94de-47a1-b665-8692acf07b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.616s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:34:57 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Deleted volume successfully.
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c80d41e-94de-47a1-b665-8692acf07b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-373601631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3119e690-1ec3-4126-bce6-6fe07625d37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:58Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e181a815-2647-4b8e-b94a-d27c277f035b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e181a815-2647-4b8e-b94a-d27c277f035b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42a11c7-2873-4f7c-9347-22f24a76b935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d42a11c7-2873-4f7c-9347-22f24a76b935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3119e690-1ec3-4126-bce6-6fe07625d37b', 'volume_name': 'volume-3119e690-1ec3-4126-bce6-6fe07625d37b', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267aef6f-4550-4795-9984-42bf64eb9566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (267aef6f-4550-4795-9984-42bf64eb9566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbcd3159-9144-4aeb-9ee6-60bef060673f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:57 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume 3119e690-1ec3-4126-bce6-6fe07625d37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3119e690-1ec3-4126-bce6-6fe07625d37b', 'volume_size': 1}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:57 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1f304ebf-14ce-4e18-9629-3b750d7bb667 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-30eb3b5f-5fe0-4ba4-9f11-96eb57f4965c-delete_volume" released by "delete_volume" :: held 1.714s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:58 devstack sudo[90654]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (562bedb6-6abc-4969-b62d-3853e892c39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff1fc2d-a96e-4f17-8ece-ace53655487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ff1fc2d-a96e-4f17-8ece-ace53655487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-936454460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726e8bb4-60c8-4b6a-8ace-0ace5da1997e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:58Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc156ea-0301-4ff4-be1b-ffdd794ca860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bc156ea-0301-4ff4-be1b-ffdd794ca860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4aa97a-6dc8-49ce-9720-5866bd6fca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e4aa97a-6dc8-49ce-9720-5866bd6fca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '726e8bb4-60c8-4b6a-8ace-0ace5da1997e', 'volume_name': 'volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2b4126-8198-4414-8281-dbbfa224fdf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2b4126-8198-4414-8281-dbbfa224fdf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3160f0-54f8-4358-a9bd-2d139dde44a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:58 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume 726e8bb4-60c8-4b6a-8ace-0ace5da1997e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e', 'volume_size': 1}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f" returned: 0 in 0.665s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:58 devstack sudo[90663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f
Apr 21 02:34:58 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:58 devstack sudo[90656]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46" returned: 0 in 0.550s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] <== create_volume: return (1257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.260s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.890s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-245122859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d764a6f1-9a0c-4d5e-aa60-f8050054ec99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:50Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Creating volume d764a6f1-9a0c-4d5e-aa60-f8050054ec99 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:58 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:58 devstack sudo[90665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99 1073741824
Apr 21 02:34:58 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ce5ff2f-7865-40e4-9eba-81e515d39514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31091637-6bb7-433a-986d-b5f65693d8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:58 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46 (37f4a67c-7ea6-47e5-b253-7d13e3fd9e46): created successfully
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31091637-6bb7-433a-986d-b5f65693d8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (7ada90ae-cadb-40c9-874b-b3c4db170381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (cd3db05a-79da-43d2-af7b-be7e07925e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83a6655-89b9-4989-a38a-ccc3218b67a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83a6655-89b9-4989-a38a-ccc3218b67a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-643712176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f3db8c-cce4-425a-90f6-b6f34d0fc41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:58Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9b40c2-af24-470d-95fa-77e58e5eb28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b9b40c2-af24-470d-95fa-77e58e5eb28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399ca088-92ec-42d2-b752-a481f8879984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (399ca088-92ec-42d2-b752-a481f8879984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83f3db8c-cce4-425a-90f6-b6f34d0fc41e', 'volume_name': 'volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a91f4b-929f-494a-bacc-f0fe05a5e17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a91f4b-929f-494a-bacc-f0fe05a5e17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6da09c7-8da0-40f1-9798-b387fee1be6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:58 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume 83f3db8c-cce4-425a-90f6-b6f34d0fc41e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e', 'volume_size': 1}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:58 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9d8bfd54-eb1c-44f2-abbd-04a5ec7c81d4 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created volume successfully.
Apr 21 02:34:58 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f" returned: 0 in 0.444s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-quobyte-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f" released by "delete_volume" :: held 1.137s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Created reservations ['d711a743-4c56-4e72-8b12-3938cef75a96', 'b996c26c-84cd-472e-b77c-0f5a939273a1', 'e45424c7-c10b-4c4c-82bd-5b93e733a7f6', '595dc7e3-72b4-4361-bab5-b272c3f02dad'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:58 devstack sudo[90671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:34:58 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:58 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99 1073741824" returned: 0 in 0.526s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:58 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:58 devstack sudo[90705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99
Apr 21 02:34:58 devstack sudo[90705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:59 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.399s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:34:59 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Deleted volume successfully.
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-3a1f58e1-e521-4ae5-86b8-4885ef253bb3 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-efcd9479-a3bd-4ce7-aaa3-852bc2aa6a1f-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:34:59 devstack sudo[90705]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99" returned: 0 in 0.403s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.632s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-790323600',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=962c14dc-9533-439b-8480-222a86f9fce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:50Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Creating volume 962c14dc-9533-439b-8480-222a86f9fce9 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:34:59 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9c0a70-746b-40aa-910e-3b517e19d042) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3685d7dc-6686-45ca-933b-78603cab5854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:34:59 devstack sudo[90711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9 1073741824
Apr 21 02:34:59 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:59 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99 (d764a6f1-9a0c-4d5e-aa60-f8050054ec99): created successfully
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3685d7dc-6686-45ca-933b-78603cab5854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (4fc3e6cf-cf4f-4f4b-ae26-e3408d19ae17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:34:59 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b5821c4b-4e6a-4ccc-b51a-4b7eb90f8700 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created volume successfully.
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "cinder-caa31b9b-7d3b-4526-8d8e-317d5789d5ca-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-caa31b9b-7d3b-4526-8d8e-317d5789d5ca-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "cinder-quobyte-caa31b9b-7d3b-4526-8d8e-317d5789d5ca" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-quobyte-caa31b9b-7d3b-4526-8d8e-317d5789d5ca" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[44698877-7539-404c-8515-7fd3384d1457]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:59 devstack sudo[90716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca
Apr 21 02:34:59 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:34:59 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9 1073741824" returned: 0 in 0.508s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:34:59 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:34:59 devstack sudo[90718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9
Apr 21 02:34:59 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:00 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca" returned: 0 in 0.494s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:00 devstack sudo[90724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca
Apr 21 02:35:00 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:00 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9" returned: 0 in 0.425s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.467s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-818670329',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54dc8463-25c4-4b5f-88c9-bf5b6243f615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:51Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Creating volume 54dc8463-25c4-4b5f-88c9-bf5b6243f615 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:00 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd36873-1ecb-4db5-83e1-8a11428dd2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-962c14dc-9533-439b-8480-222a86f9fce9', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbc2705-5aaf-4e80-8d65-e69489a2c273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:00 devstack sudo[90726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615 1073741824
Apr 21 02:35:00 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:00 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume volume-962c14dc-9533-439b-8480-222a86f9fce9 (962c14dc-9533-439b-8480-222a86f9fce9): created successfully
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bbc2705-5aaf-4e80-8d65-e69489a2c273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (f163c7af-b593-47b4-93ca-546a8e53b277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:00 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9940a5a8-502c-4865-b3d9-a1a2492bff27 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created volume successfully.
Apr 21 02:35:00 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-caa31b9b-7d3b-4526-8d8e-317d5789d5ca" returned: 0 in 0.436s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-quobyte-caa31b9b-7d3b-4526-8d8e-317d5789d5ca" released by "delete_volume" :: held 0.952s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Created reservations ['bc9c07f5-8b25-44e1-92ab-3c1855455979', 'd958d7fb-175a-4952-b770-5fc003c9c790', '5180d762-61ad-4767-977a-452009bfd788', '677ce39d-d1f8-40a9-ae44-37ea6b0fa1f6'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:00 devstack sudo[90732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:00 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:00 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615 1073741824" returned: 0 in 0.498s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "cinder-7e31b59a-219b-484c-8343-11ecf9852870-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-7e31b59a-219b-484c-8343-11ecf9852870-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:00 devstack sudo[90734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615
Apr 21 02:35:00 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "cinder-quobyte-7e31b59a-219b-484c-8343-11ecf9852870" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-quobyte-7e31b59a-219b-484c-8343-11ecf9852870" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b5c786-2cf7-475d-80f8-1cc0204571b4]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:00 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:00 devstack sudo[90736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870
Apr 21 02:35:00 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:01 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.423s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:01 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Deleted volume successfully.
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d9db396b-bcfa-438b-8dd5-07b1764d78a9 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-caa31b9b-7d3b-4526-8d8e-317d5789d5ca-delete_volume" released by "delete_volume" :: held 1.499s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:01 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615" returned: 0 in 0.418s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.231s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-335760393',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10bd869a-c469-4a97-afc6-6086f3efdfa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9cf0326585424dbf77560453fab2b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:51Z,use_quota=True,user_id='0492a5691582416ba805e9a65b639772',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Creating volume 10bd869a-c469-4a97-afc6-6086f3efdfa0 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:01 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee66d7b0-b65c-4f78-bd92-4705fd42753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e84d099-c874-4e0a-af43-61ced7983e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:01 devstack sudo[90741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0 1073741824
Apr 21 02:35:01 devstack sudo[90741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:01 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615 (54dc8463-25c4-4b5f-88c9-bf5b6243f615): created successfully
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e84d099-c874-4e0a-af43-61ced7983e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (59fe56d4-9f83-46fa-9e4e-96e4f777e4c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:01 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-dfbed025-544a-4038-ba17-af8d3639fdf3 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created volume successfully.
Apr 21 02:35:01 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870" returned: 0 in 0.480s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:01 devstack sudo[90745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870
Apr 21 02:35:01 devstack sudo[90745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:01 devstack sudo[90745]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:01 devstack sudo[90741]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7e31b59a-219b-484c-8343-11ecf9852870" returned: 0 in 0.411s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0 1073741824" returned: 0 in 0.521s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-quobyte-7e31b59a-219b-484c-8343-11ecf9852870" released by "delete_volume" :: held 0.920s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:01 devstack sudo[90752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0
Apr 21 02:35:01 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Created reservations ['c58222c5-9d8d-4889-b3bd-9dee34fc86ea', '79705e2e-b384-49d0-86ee-b085576000b0', 'acc59f28-a224-4dfb-a01a-d8362afa0555', '6ff5ab3b-463c-47cb-b8d8-c28091e3c6f2'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:01 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:01 devstack sudo[90754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:01 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:02 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0" returned: 0 in 0.401s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.999s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51a4101b-b113-43ca-b462-95cec33d7f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10bd869a-c469-4a97-afc6-6086f3efdfa0', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb65124-4bde-47e4-99f7-d6f676b363a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] Creating offline snapshot 161490e5-ffdf-48ed-a8f3-db06a49da237 of volume 85e48c70-3d51-4c55-b39b-e117a04e927d {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:35:02 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Volume volume-10bd869a-c469-4a97-afc6-6086f3efdfa0 (10bd869a-c469-4a97-afc6-6086f3efdfa0): created successfully
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb65124-4bde-47e4-99f7-d6f676b363a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Flow 'volume_create_manager' (22d9d940-95c1-42f4-9305-897c02944c49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82b1bae-e8ac-4926-a523-65ae46c793f0]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:02 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-72dd2437-7eba-4437-8494-79a4ac38f8cd tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created volume successfully.
Apr 21 02:35:02 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.410s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:02 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Deleted volume successfully.
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-f60d0678-4935-4421-bf6d-ecd25ee02c36 tempest-CreateVolumesFromImageTest-625486566 None] Lock "cinder-7e31b59a-219b-484c-8343-11ecf9852870-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:02 devstack sudo[90758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d
Apr 21 02:35:02 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:02 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d" returned: 0 in 0.471s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:02 devstack sudo[90763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237 1G
Apr 21 02:35:02 devstack sudo[90763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-10bd869a-c469-4a97-afc6-6086f3efdfa0-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-10bd869a-c469-4a97-afc6-6086f3efdfa0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-quobyte-10bd869a-c469-4a97-afc6-6086f3efdfa0" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-10bd869a-c469-4a97-afc6-6086f3efdfa0" acquired by "delete_volume" :: waited 0.006s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb80cdf-e2ca-4713-8b84-62ed1e40b925]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:02 devstack sudo[90765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0
Apr 21 02:35:02 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_service.periodic_task [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82686) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:02 devstack sudo[90767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:02 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:03 devstack sudo[90763]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237 1G" returned: 0 in 0.520s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e48c70-3d51-4c55-b39b-e117a04e927d -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:03 devstack sudo[90773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e48c70-3d51-4c55-b39b-e117a04e927d -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237
Apr 21 02:35:03 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:03 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0" returned: 0 in 0.559s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:03 devstack sudo[90777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0
Apr 21 02:35:03 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:03 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.515s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:03 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-85e48c70-3d51-4c55-b39b-e117a04e927d -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237" returned: 0 in 0.569s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:03 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237 is being set with open permissions: ugo+rw
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:03 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-10bd869a-c469-4a97-afc6-6086f3efdfa0" returned: 0 in 0.470s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-10bd869a-c469-4a97-afc6-6086f3efdfa0" released by "delete_volume" :: held 1.060s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:03 devstack sudo[90784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237
Apr 21 02:35:03 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created reservations ['e7b5bae1-91a7-4a9c-a6ba-27c01d432c7d', 'e7311e35-41d6-4bde-b19b-6fb5f272ba22', '2bd46841-4403-41fe-b173-c946138d5393', '47c5c766-773e-4958-a357-697e621de78c'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:03 devstack sudo[90786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:03 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:04 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237" returned: 0 in 0.472s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:04 devstack sudo[90789]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.info
Apr 21 02:35:04 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:04 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.489s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:04 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Deleted volume successfully.
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-d7cf07f3-bb2c-4de0-ba7c-58cd16402389 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-10bd869a-c469-4a97-afc6-6086f3efdfa0-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:04 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.info" returned: 0 in 0.482s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:04 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.info is being set with open permissions: ugo+rw
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:04 devstack sudo[90793]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.info
Apr 21 02:35:04 devstack sudo[90793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-54dc8463-25c4-4b5f-88c9-bf5b6243f615-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-54dc8463-25c4-4b5f-88c9-bf5b6243f615-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-quobyte-54dc8463-25c4-4b5f-88c9-bf5b6243f615" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-54dc8463-25c4-4b5f-88c9-bf5b6243f615" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e49667-eec6-4b18-9bfc-bf0260541d63]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:04 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:05 devstack sudo[90795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615
Apr 21 02:35:05 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:05 devstack sudo[90793]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.info" returned: 0 in 0.485s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.068s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.585s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1861533485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee78dee4-3adb-46e3-946f-5c47496a1ac2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:57Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Creating volume ee78dee4-3adb-46e3-946f-5c47496a1ac2 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:05 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:05 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-5d45e4ea-61f8-4b7d-80d0-1318696bc9d0 tempest-VolumeDependencyTests-500811021 None] Create snapshot completed successfully
Apr 21 02:35:05 devstack sudo[90798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2 1073741824
Apr 21 02:35:05 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:05 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615" returned: 0 in 0.548s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:05 devstack sudo[90803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615
Apr 21 02:35:05 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:05 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2 1073741824" returned: 0 in 0.534s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:05 devstack sudo[90808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2
Apr 21 02:35:05 devstack sudo[90808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Flow 'volume_create_manager' (99040df3-d687-4c79-8f70-6c6d190e0431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c3440e-217c-42d6-b6e9-843549a900a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94c3440e-217c-42d6-b6e9-843549a900a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1281387226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=465a9a28-97aa-40ad-893b-46dca1cb23f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798f1e49d824dbd9cf430d457c70743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=161490e5-ffdf-48ed-a8f3-db06a49da237,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:35:06Z,use_quota=True,user_id='74b3bb8323ee4dae9e42c8d8c36b8e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90176685-1e48-4199-8d69-6d98048f870d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:05 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90176685-1e48-4199-8d69-6d98048f870d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326a49da-baeb-48dc-8cae-14c0d15178a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (326a49da-baeb-48dc-8cae-14c0d15178a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '465a9a28-97aa-40ad-893b-46dca1cb23f3', 'volume_name': 'volume-465a9a28-97aa-40ad-893b-46dca1cb23f3', 'volume_size': 1, 'snapshot_id': '161490e5-ffdf-48ed-a8f3-db06a49da237'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eee0b48-5681-4a65-b0ae-ea088785dc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eee0b48-5681-4a65-b0ae-ea088785dc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa73e36-d3b2-4a37-af95-40faabdb7764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:06 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Volume 465a9a28-97aa-40ad-893b-46dca1cb23f3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-465a9a28-97aa-40ad-893b-46dca1cb23f3', 'volume_size': 1, 'snapshot_id': '161490e5-ffdf-48ed-a8f3-db06a49da237'}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:06 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-54dc8463-25c4-4b5f-88c9-bf5b6243f615" returned: 0 in 0.559s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-54dc8463-25c4-4b5f-88c9-bf5b6243f615" released by "delete_volume" :: held 1.128s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created reservations ['8104683f-4ba4-4921-b627-ce4e52676b2e', 'a41a0d14-722b-4cbf-a609-ea9835a35a64', '30f4219d-2381-4745-8737-7aba10f5ae29', '9582e67b-6fc7-44e2-a29e-28482743cb2c'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:06 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:06 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:06 devstack sudo[90808]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2" returned: 0 in 0.494s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.516s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1818770794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6f259c-c5c5-47a0-abc9-13c32bd4c159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:58Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Creating volume 4d6f259c-c5c5-47a0-abc9-13c32bd4c159 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:06 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8989833f-192e-4f17-a3ed-47bf4c8df6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5f6618-af23-4ca7-a584-779e8b90f027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:06 devstack sudo[90814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159 1073741824
Apr 21 02:35:06 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:06 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2 (ee78dee4-3adb-46e3-946f-5c47496a1ac2): created successfully
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb5f6618-af23-4ca7-a584-779e8b90f027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (705180d9-c7e1-4485-ae50-b0507d8bf8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:06 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-92ee7b11-7c9e-4e60-8659-5938e68bda04 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created volume successfully.
Apr 21 02:35:06 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.493s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:06 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Deleted volume successfully.
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-dadb19eb-9b66-4620-a010-e08b6ef077d1 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-54dc8463-25c4-4b5f-88c9-bf5b6243f615-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:06 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159 1073741824" returned: 0 in 0.560s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:06 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:06 devstack sudo[90820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159
Apr 21 02:35:06 devstack sudo[90820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-962c14dc-9533-439b-8480-222a86f9fce9-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-962c14dc-9533-439b-8480-222a86f9fce9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-quobyte-962c14dc-9533-439b-8480-222a86f9fce9" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-962c14dc-9533-439b-8480-222a86f9fce9" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee5136d-c5cf-4bfe-8b94-323b4a1afdfa]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:07 devstack sudo[90822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9
Apr 21 02:35:07 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:07 devstack sudo[90820]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159" returned: 0 in 0.446s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.342s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-373601631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3119e690-1ec3-4126-bce6-6fe07625d37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:58Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Creating volume 3119e690-1ec3-4126-bce6-6fe07625d37b {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:07 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c65087dd-1079-454e-b383-dfe7a36b6b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3f9ef1-21d0-4632-af1a-f0e61504fb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:07 devstack sudo[90825]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b 1073741824
Apr 21 02:35:07 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:07 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159 (4d6f259c-c5c5-47a0-abc9-13c32bd4c159): created successfully
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e3f9ef1-21d0-4632-af1a-f0e61504fb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (b1d01870-a6a0-45e8-97db-4aa281feb19a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:07 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-244bdec0-2152-48df-ab9d-f0ef3d52857c tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created volume successfully.
Apr 21 02:35:07 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9" returned: 0 in 0.562s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:07 devstack sudo[90830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9
Apr 21 02:35:07 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:07 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b 1073741824" returned: 0 in 0.583s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:07 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:07 devstack sudo[90835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b
Apr 21 02:35:07 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:08 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-962c14dc-9533-439b-8480-222a86f9fce9" returned: 0 in 0.544s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-962c14dc-9533-439b-8480-222a86f9fce9" released by "delete_volume" :: held 1.132s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created reservations ['df743448-54b1-4543-b970-f16e33828313', '7ccca775-c994-4bc2-8fbd-11a8d084dcc1', '1b533c80-27de-4e08-a99a-a4bfae5ac8ba', '9172e667-4a82-404c-8a98-f8c6d3d2483c'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:08 devstack sudo[90838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:08 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:08 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b" returned: 0 in 0.544s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.358s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-936454460',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=726e8bb4-60c8-4b6a-8ace-0ace5da1997e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:58Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Creating volume 726e8bb4-60c8-4b6a-8ace-0ace5da1997e {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:08 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbcd3159-9144-4aeb-9ee6-60bef060673f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3119e690-1ec3-4126-bce6-6fe07625d37b', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8318a40f-8fa3-4686-a874-5b7e528886d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:08 devstack sudo[90841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e 1073741824
Apr 21 02:35:08 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:08 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume volume-3119e690-1ec3-4126-bce6-6fe07625d37b (3119e690-1ec3-4126-bce6-6fe07625d37b): created successfully
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8318a40f-8fa3-4686-a874-5b7e528886d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (0cfa0be4-074d-4713-bf49-8ea1d7db099d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:08 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-f1e2e9a0-f9b5-4ff0-8767-7acbd025943f tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created volume successfully.
Apr 21 02:35:08 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.575s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:08 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Deleted volume successfully.
Apr 21 02:35:08 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0fc345af-9c90-488e-9b4a-566ecad21786 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-962c14dc-9533-439b-8480-222a86f9fce9-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:09 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e 1073741824" returned: 0 in 0.638s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:09 devstack sudo[90847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e
Apr 21 02:35:09 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-d764a6f1-9a0c-4d5e-aa60-f8050054ec99-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-d764a6f1-9a0c-4d5e-aa60-f8050054ec99-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-quobyte-d764a6f1-9a0c-4d5e-aa60-f8050054ec99" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-d764a6f1-9a0c-4d5e-aa60-f8050054ec99" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a3856f-f4bc-4e43-8d32-87ebc9db2fef]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:09 devstack sudo[90849]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99
Apr 21 02:35:09 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:09 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e" returned: 0 in 0.437s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.247s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-643712176',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83f3db8c-cce4-425a-90f6-b6f34d0fc41e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5c8e754ac6349229f48047082550f6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:34:58Z,use_quota=True,user_id='161795f5c7904adbb0477565bca0b475',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Creating volume 83f3db8c-cce4-425a-90f6-b6f34d0fc41e {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:09 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f3160f0-54f8-4358-a9bd-2d139dde44a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48d10e2-0d2d-4837-9e3b-f99465faa552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:09 devstack sudo[90852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e 1073741824
Apr 21 02:35:09 devstack sudo[90852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:09 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e (726e8bb4-60c8-4b6a-8ace-0ace5da1997e): created successfully
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48d10e2-0d2d-4837-9e3b-f99465faa552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (562bedb6-6abc-4969-b62d-3853e892c39d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:09 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-ece57b3e-1b3c-4a13-b9e0-624b4ebe5a17 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created volume successfully.
Apr 21 02:35:09 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99" returned: 0 in 0.610s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:09 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:09 devstack sudo[90857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99
Apr 21 02:35:09 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:10 devstack sudo[90852]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e 1073741824" returned: 0 in 0.637s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:10 devstack sudo[90862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e
Apr 21 02:35:10 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:10 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-d764a6f1-9a0c-4d5e-aa60-f8050054ec99" returned: 0 in 0.579s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-d764a6f1-9a0c-4d5e-aa60-f8050054ec99" released by "delete_volume" :: held 1.214s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created reservations ['a320edba-fb49-453f-b387-bf62211bebf4', 'b1452a89-0565-41b5-8982-a117d4f01901', 'e3c69196-6f53-4752-86fe-11a538ee88b3', 'ac415827-4c54-49bc-983a-0e000059528c'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:10 devstack sudo[90865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:10 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:10 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e" returned: 0 in 0.510s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.809s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-quobyte-161490e5-ffdf-48ed-a8f3-db06a49da237-465a9a28-97aa-40ad-893b-46dca1cb23f3" by "_create_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6da09c7-8da0-40f1-9798-b387fee1be6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e7addf-8735-431b-b3f3-e37a64a1643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-161490e5-ffdf-48ed-a8f3-db06a49da237-465a9a28-97aa-40ad-893b-46dca1cb23f3" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Creating volume 465a9a28-97aa-40ad-893b-46dca1cb23f3 from snapshot 161490e5-ffdf-48ed-a8f3-db06a49da237 {{(pid=82686) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-quobyte-465a9a28-97aa-40ad-893b-46dca1cb23f3" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:10 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Volume volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e (83f3db8c-cce4-425a-90f6-b6f34d0fc41e): created successfully
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97e7addf-8735-431b-b3f3-e37a64a1643d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Flow 'volume_create_manager' (cd3db05a-79da-43d2-af7b-be7e07925e4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-465a9a28-97aa-40ad-893b-46dca1cb23f3" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] snapshot: 161490e5-ffdf-48ed-a8f3-db06a49da237, volume: 465a9a28-97aa-40ad-893b-46dca1cb23f3,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:35:10 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-bfcd8e3b-1c30-49c5-b3da-0a6c82861dd3 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created volume successfully.
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cba74b-259f-43a3-a752-f5786e4ff698]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:10 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:11 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237
Apr 21 02:35:11 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:11 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.574s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:11 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Deleted volume successfully.
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-a1d1639b-f2f3-4435-9bee-216551dfb75b tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-d764a6f1-9a0c-4d5e-aa60-f8050054ec99-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-83f3db8c-cce4-425a-90f6-b6f34d0fc41e-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-83f3db8c-cce4-425a-90f6-b6f34d0fc41e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-quobyte-83f3db8c-cce4-425a-90f6-b6f34d0fc41e" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-83f3db8c-cce4-425a-90f6-b6f34d0fc41e" acquired by "delete_volume" :: waited 0.014s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa0b7c1-c404-4382-b48b-8265391abd7c]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:11 devstack sudo[90873]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e
Apr 21 02:35:11 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:11 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237" returned: 0 in 0.572s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85e48c70-3d51-4c55-b39b-e117a04e927d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb772872-0b21-49b9-9191-c51bf6902b1e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-quobyte-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae372342-e6b9-4468-96c3-54005249e8e6]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:11 devstack sudo[90878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d
Apr 21 02:35:11 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:11 devstack sudo[90879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46
Apr 21 02:35:11 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:11 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e" returned: 0 in 0.523s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:11 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:11 devstack sudo[90885]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e
Apr 21 02:35:11 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:12 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d" returned: 0 in 0.500s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3 not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:12 devstack sudo[90893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3
Apr 21 02:35:12 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:12 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46" returned: 0 in 0.531s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:12 devstack sudo[90895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46
Apr 21 02:35:12 devstack sudo[90895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:12 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-83f3db8c-cce4-425a-90f6-b6f34d0fc41e" returned: 0 in 0.553s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-83f3db8c-cce4-425a-90f6-b6f34d0fc41e" released by "delete_volume" :: held 1.098s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created reservations ['937fd6df-8633-4c5b-8a89-26b3d86363e9', '24c2e870-bb56-4335-b1da-7c12a4acfadc', '25df26bb-beff-4c83-aed3-72f4d3405c6e', '8e198a21-cf0c-403f-a722-d3f18319e9ab'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:12 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:12 devstack sudo[90915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:12 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:13 devstack sudo[90895]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46" returned: 0 in 1.116s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46" released by "delete_volume" :: held 1.673s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created reservations ['f505fa5d-fb18-4623-919a-9c29cddeac15', 'd0ff3e4a-f241-40fb-807b-92c4d27fb603', '01cc4d99-0263-4f44-9f2d-a2f2a3a71802', 'a8cce6c0-be28-4f31-8e5c-f65c92e10692'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:13 devstack sudo[90917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:13 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-726e8bb4-60c8-4b6a-8ace-0ace5da1997e-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-726e8bb4-60c8-4b6a-8ace-0ace5da1997e-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-quobyte-726e8bb4-60c8-4b6a-8ace-0ace5da1997e" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-726e8bb4-60c8-4b6a-8ace-0ace5da1997e" acquired by "delete_volume" :: waited 0.056s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-44abc718-51b1-4f85-8965-8082159aa63c-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[82aef9fd-a52d-4ae9-8c88-df8dfe5adc57]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:13 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-44abc718-51b1-4f85-8965-8082159aa63c-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "cinder-quobyte-44abc718-51b1-4f85-8965-8082159aa63c" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:14 devstack sudo[90919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e
Apr 21 02:35:14 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-44abc718-51b1-4f85-8965-8082159aa63c" acquired by "delete_volume" :: waited 0.050s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0497d1f-02e8-48df-9e74-96235ac7e7fd]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:14 devstack sudo[90921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c
Apr 21 02:35:14 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:14 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3" returned: 0 in 2.476s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[125593f0-5402-409f-b9fa-a48ee321aa00]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:14 devstack sudo[90923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d
Apr 21 02:35:14 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:14 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 1.924s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:14 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Deleted volume successfully.
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e7cc9dd7-9462-4dd1-ace9-b997eac5edea tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-83f3db8c-cce4-425a-90f6-b6f34d0fc41e-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:14 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e" returned: 0 in 0.973s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:14 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 1.357s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:14 devstack sudo[90933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e
Apr 21 02:35:14 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:14 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Deleted volume successfully.
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-6e9ad22b-9bcd-4d37-83de-6e5f4d9e4fe9 tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-37f4a67c-7ea6-47e5-b253-7d13e3fd9e46-delete_volume" released by "delete_volume" :: held 3.396s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:14 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c" returned: 0 in 0.705s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:14 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:14 devstack sudo[90935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c
Apr 21 02:35:14 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:15 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d" returned: 0 in 0.737s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d, size 1024.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:35:15 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Converted 1024.00 MB image at 411.46 MB/s
Apr 21 02:35:15 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3 is being set with open permissions: ugo+rw
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:15 devstack sudo[90941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3
Apr 21 02:35:15 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:15 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-726e8bb4-60c8-4b6a-8ace-0ace5da1997e" returned: 0 in 0.534s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-726e8bb4-60c8-4b6a-8ace-0ace5da1997e" released by "delete_volume" :: held 1.557s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created reservations ['0dfaaac6-b61c-4c02-83f0-74b005962ae1', 'f77aa98c-d8c3-4590-a3fb-e5194c415f3f', '7ac613f6-f19b-4e27-96c5-0ad55049fe6d', '359b2503-8052-4d34-b1dc-4f1b9e553993'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:15 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-44abc718-51b1-4f85-8965-8082159aa63c" returned: 0 in 0.477s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-quobyte-44abc718-51b1-4f85-8965-8082159aa63c" released by "delete_volume" :: held 1.233s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:15 devstack sudo[90944]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:15 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Created reservations ['1b0972af-98cc-4817-a614-927444bbbc7b', '9a38c98b-cf64-432a-a3f2-0ea511842889', '537df635-d65e-4488-88f5-751b29b999b0', '0ea0db47-0d11-4f79-9724-9985942801b1'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:15 devstack sudo[90946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:15 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:15 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3" returned: 0 in 0.623s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-465a9a28-97aa-40ad-893b-46dca1cb23f3" released by "_copy_volume_from_snapshot" :: held 4.996s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-161490e5-ffdf-48ed-a8f3-db06a49da237-465a9a28-97aa-40ad-893b-46dca1cb23f3" released by "_create_volume_from_snapshot" :: held 5.034s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.061s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-3119e690-1ec3-4126-bce6-6fe07625d37b-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa73e36-d3b2-4a37-af95-40faabdb7764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-465a9a28-97aa-40ad-893b-46dca1cb23f3', 'volume_size': 1, 'snapshot_id': '161490e5-ffdf-48ed-a8f3-db06a49da237'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81138d2f-1ec9-4ae3-bcb2-f28f2f5e0314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-3119e690-1ec3-4126-bce6-6fe07625d37b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:15 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Volume volume-465a9a28-97aa-40ad-893b-46dca1cb23f3 (465a9a28-97aa-40ad-893b-46dca1cb23f3): created successfully
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81138d2f-1ec9-4ae3-bcb2-f28f2f5e0314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:15 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Flow 'volume_create_manager' (99040df3-d687-4c79-8f70-6c6d190e0431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-quobyte-3119e690-1ec3-4126-bce6-6fe07625d37b" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:16 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1181e4a4-aad2-4df2-b467-f1933764c3b4 tempest-VolumeDependencyTests-500811021 None] Created volume successfully.
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-3119e690-1ec3-4126-bce6-6fe07625d37b" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:16 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.579s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a628b4a4-2060-44b9-bd93-6b3302dfa473]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:16 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Deleted volume successfully.
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ac5963a-70be-43fd-a4b9-cc56f02cad30 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-726e8bb4-60c8-4b6a-8ace-0ace5da1997e-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:16 devstack sudo[90950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b
Apr 21 02:35:16 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:16 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.554s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:16 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Deleted volume successfully.
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-0ee1c819-f20c-422c-bfb4-b052da2fab7e tempest-CreateVolumesFromSourceVolumeTest-670818291 None] Lock "cinder-44abc718-51b1-4f85-8965-8082159aa63c-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:16 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b" returned: 0 in 0.629s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:16 devstack sudo[90956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b
Apr 21 02:35:16 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-161490e5-ffdf-48ed-a8f3-db06a49da237-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-161490e5-ffdf-48ed-a8f3-db06a49da237-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-quobyte-85e48c70-3d51-4c55-b39b-e117a04e927d" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-85e48c70-3d51-4c55-b39b-e117a04e927d" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-quobyte-161490e5-ffdf-48ed-a8f3-db06a49da237" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-161490e5-ffdf-48ed-a8f3-db06a49da237" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Deleting offline snapshot 161490e5-ffdf-48ed-a8f3-db06a49da237 of volume 85e48c70-3d51-4c55-b39b-e117a04e927d {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] snapshot_file for this snap is: volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[03354914-c505-4a30-8ef9-c2af7fe6c472]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:16 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:16 devstack sudo[90958]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237
Apr 21 02:35:16 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:17 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3119e690-1ec3-4126-bce6-6fe07625d37b" returned: 0 in 0.639s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-3119e690-1ec3-4126-bce6-6fe07625d37b" released by "delete_volume" :: held 1.294s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created reservations ['ca7645e6-ccf0-4c72-9fee-beb2ffb87d91', '1a1807e0-3159-49c7-985f-3236748cdb9a', '49147f7f-efd8-42c7-9f58-dd3041091856', 'f55c09b2-0cf0-4dca-a867-f645b5f4813d'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:17 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237" returned: 0 in 0.617s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-85e48c70-3d51-4c55-b39b-e117a04e927d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:35:17 devstack sudo[90964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:17 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[20922484-ce47-4194-836c-bd9a07fb9dc1]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:17 devstack sudo[90966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d
Apr 21 02:35:17 devstack sudo[90966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:17 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.591s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:17 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:18 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Deleted volume successfully.
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-8cfcddcf-a65f-4638-b7b2-f601ecf1db03 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-3119e690-1ec3-4126-bce6-6fe07625d37b-delete_volume" released by "delete_volume" :: held 2.042s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-4d6f259c-c5c5-47a0-abc9-13c32bd4c159-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-4d6f259c-c5c5-47a0-abc9-13c32bd4c159-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-quobyte-4d6f259c-c5c5-47a0-abc9-13c32bd4c159" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-4d6f259c-c5c5-47a0-abc9-13c32bd4c159" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[574bfb82-a911-4293-a77e-15c62046a8b5]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:18 devstack sudo[90966]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d" returned: 0 in 0.758s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:18 devstack sudo[90973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237
Apr 21 02:35:18 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:18 devstack sudo[90972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159
Apr 21 02:35:18 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Flow 'volume_create_manager' (7fdf1c73-94f4-4da1-a276-5e810a477627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50814cff-86d5-40a3-aa79-6cb0c4727e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50814cff-86d5-40a3-aa79-6cb0c4727e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3841ab41-5c2d-4dae-80bd-eeb66d19ae48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc59e47358b47adb56f31cd300a35b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:35:18Z,use_quota=True,user_id='a66381aeaa64480a9c563d0ba5c3f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7919bdd0-27e2-4fea-b485-52e5382852dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7919bdd0-27e2-4fea-b485-52e5382852dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5deb8fe-f433-408c-9a3d-ec508c5eed31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5deb8fe-f433-408c-9a3d-ec508c5eed31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3841ab41-5c2d-4dae-80bd-eeb66d19ae48', 'volume_name': 'volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f3b213-f502-4b4c-b96f-91e1302e5cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f3b213-f502-4b4c-b96f-91e1302e5cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b13afa7-ecef-463e-b9bc-eebee5dda2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:18 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Volume 3841ab41-5c2d-4dae-80bd-eeb66d19ae48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48', 'volume_size': 1}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3841ab41-5c2d-4dae-80bd-eeb66d19ae48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc59e47358b47adb56f31cd300a35b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:35:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:35:18Z,use_quota=True,user_id='a66381aeaa64480a9c563d0ba5c3f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Creating volume 3841ab41-5c2d-4dae-80bd-eeb66d19ae48 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:18 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:18 devstack sudo[90976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48 1073741824
Apr 21 02:35:18 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:18 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237" returned: 0 in 0.613s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:18 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:18 devstack sudo[90984]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237
Apr 21 02:35:18 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:19 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48 1073741824" returned: 0 in 0.593s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:19 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159" returned: 0 in 0.811s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:19 devstack sudo[90989]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159
Apr 21 02:35:19 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:19 devstack sudo[90991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48
Apr 21 02:35:19 devstack sudo[90991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:19 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d.161490e5-ffdf-48ed-a8f3-db06a49da237" returned: 0 in 0.544s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-161490e5-ffdf-48ed-a8f3-db06a49da237" released by "_delete_snapshot" :: held 2.613s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-85e48c70-3d51-4c55-b39b-e117a04e927d" released by "delete_snapshot" :: held 2.632s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Created reservations ['ff340328-30fc-45f7-a3d0-c11dd4bd6ed6', '170ef471-9afd-4788-b2c3-7ea27f133293', 'bcc3926b-ea44-4531-b3b5-8f3d1ea2a26e', '02a94604-2907-4448-beb5-7cd90423f4c8'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:19 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Delete snapshot completed successfully.
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-5e78f06d-8b71-45e0-a14b-c258bd91ce00 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-161490e5-ffdf-48ed-a8f3-db06a49da237-delete_snapshot" released by "delete_snapshot" :: held 2.717s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:19 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-4d6f259c-c5c5-47a0-abc9-13c32bd4c159" returned: 0 in 0.555s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-4d6f259c-c5c5-47a0-abc9-13c32bd4c159" released by "delete_volume" :: held 1.409s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created reservations ['8403f405-ca2f-438e-9d3b-9337baf31451', 'cd00d025-d068-4381-a455-d83576156739', 'd27ca510-bb0a-43ae-8f94-912a18467a48', '5925d50b-7f6c-4644-ab91-de05d891e363'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:19 devstack sudo[90991]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48" returned: 0 in 0.594s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] <== create_volume: return (1238ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b13afa7-ecef-463e-b9bc-eebee5dda2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1bec6d-b269-4a36-8e2a-91c4ace15d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:19 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Volume volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48 (3841ab41-5c2d-4dae-80bd-eeb66d19ae48): created successfully
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a1bec6d-b269-4a36-8e2a-91c4ace15d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Flow 'volume_create_manager' (7fdf1c73-94f4-4da1-a276-5e810a477627) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:19 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-317dde63-d341-40f4-aa57-56e911e70d3b tempest-CinderUnicodeTest-351844940 None] Created volume successfully.
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:19 devstack sudo[90996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:19 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-85e48c70-3d51-4c55-b39b-e117a04e927d-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:19 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Lock "cinder-85e48c70-3d51-4c55-b39b-e117a04e927d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-quobyte-85e48c70-3d51-4c55-b39b-e117a04e927d" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-85e48c70-3d51-4c55-b39b-e117a04e927d" acquired by "delete_volume" :: waited 0.018s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f575918-8a92-419e-93cd-393e93346e0a]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:20 devstack sudo[90998]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d
Apr 21 02:35:20 devstack sudo[90998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:20 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.549s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:20 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Deleted volume successfully.
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-cdc10675-1aa9-4e09-bf3e-9a728e4c2c78 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-4d6f259c-c5c5-47a0-abc9-13c32bd4c159-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-ee78dee4-3adb-46e3-946f-5c47496a1ac2-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-ee78dee4-3adb-46e3-946f-5c47496a1ac2-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-quobyte-ee78dee4-3adb-46e3-946f-5c47496a1ac2" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-ee78dee4-3adb-46e3-946f-5c47496a1ac2" acquired by "delete_volume" :: waited 0.024s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[7911916b-9c93-430d-8265-310e4c31dc94]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:20 devstack sudo[91001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2
Apr 21 02:35:20 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:20 devstack sudo[90998]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d" returned: 0 in 0.715s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:20 devstack sudo[91006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d
Apr 21 02:35:20 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Flow 'volume_create_manager' (a15c2676-f1b3-4e0a-baa3-bddc04dc15c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e447d07-dd72-405d-ba3a-639781e862ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e447d07-dd72-405d-ba3a-639781e862ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1239292736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d31aff2-dbfc-4a95-bccb-b7653eccd17b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1cbeb190394128b671690973b27de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:35:21Z,use_quota=True,user_id='885c096ed5f541809d7b1f84af98e26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ad4337-55fe-4b8b-9267-e4a7bb6c3be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12ad4337-55fe-4b8b-9267-e4a7bb6c3be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bb58e6-67a3-4247-8204-caf841226d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82bb58e6-67a3-4247-8204-caf841226d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d31aff2-dbfc-4a95-bccb-b7653eccd17b', 'volume_name': 'volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3ed6ee-300e-40d9-874d-a6cfe08241f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3ed6ee-300e-40d9-874d-a6cfe08241f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd67f79-53ea-499f-b0a0-70604ddf721c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:20 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Volume 1d31aff2-dbfc-4a95-bccb-b7653eccd17b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b', 'volume_size': 1}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1239292736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d31aff2-dbfc-4a95-bccb-b7653eccd17b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1cbeb190394128b671690973b27de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:35:21Z,use_quota=True,user_id='885c096ed5f541809d7b1f84af98e26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Creating volume 1d31aff2-dbfc-4a95-bccb-b7653eccd17b {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:20 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:20 devstack sudo[91008]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b 1073741824
Apr 21 02:35:20 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Flow 'volume_create_manager' (9ec06826-701a-4ca3-9a33-4ca1e00dad1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d00f83-4fa6-4d7f-815b-bae86b85dc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55d00f83-4fa6-4d7f-815b-bae86b85dc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:35:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-772350042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1a2594-8218-4bdd-906a-70a9afab74f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc59e47358b47adb56f31cd300a35b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:35:21Z,use_quota=True,user_id='a66381aeaa64480a9c563d0ba5c3f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c3d494-fc54-44d6-88a5-b54b1803364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c3d494-fc54-44d6-88a5-b54b1803364d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526e64d1-bcc6-498b-bfe7-fd78d1f9eff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (526e64d1-bcc6-498b-bfe7-fd78d1f9eff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1a2594-8218-4bdd-906a-70a9afab74f1', 'volume_name': 'volume-7a1a2594-8218-4bdd-906a-70a9afab74f1', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432b7090-3354-45c7-97ee-95a2d5ac9438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (432b7090-3354-45c7-97ee-95a2d5ac9438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee838013-cd1a-4add-a172-6f6336fd1932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:20 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Volume 7a1a2594-8218-4bdd-906a-70a9afab74f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1a2594-8218-4bdd-906a-70a9afab74f1', 'volume_size': 1}
Apr 21 02:35:20 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:21 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2" returned: 0 in 0.547s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:21 devstack sudo[91013]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2
Apr 21 02:35:21 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:21 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-85e48c70-3d51-4c55-b39b-e117a04e927d" returned: 0 in 0.496s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-85e48c70-3d51-4c55-b39b-e117a04e927d" released by "delete_volume" :: held 1.244s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Created reservations ['17d73873-73ed-4f2e-a6af-3f53330e2440', 'f1d556f4-5789-41a8-aa88-2172f08573fc', 'f88de9fe-2359-4ab2-bb26-16c831563563', 'd85979e8-56bb-4a9f-a951-edbb17df166e'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:21 devstack sudo[91020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:21 devstack sudo[91020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:21 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b 1073741824" returned: 0 in 0.539s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:21 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-ee78dee4-3adb-46e3-946f-5c47496a1ac2" returned: 0 in 0.441s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:21 devstack sudo[91023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b
Apr 21 02:35:21 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-ee78dee4-3adb-46e3-946f-5c47496a1ac2" released by "delete_volume" :: held 1.015s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created reservations ['214e58ec-71d3-46be-ab0d-49a5ab9ad49e', '9bb25895-11c6-4bdc-92c2-2b59e3232f7a', 'f97f610b-5757-4cd6-82c1-e12b9d081e23', 'bab21768-b872-484b-8ede-0f7b136d9184'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:21 devstack sudo[91025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:21 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:21 devstack sudo[91020]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.447s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:21 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Deleted volume successfully.
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-e18d7fe1-418d-44df-a527-79d34e20481a tempest-VolumeDependencyTests-500811021 None] Lock "cinder-85e48c70-3d51-4c55-b39b-e117a04e927d-delete_volume" released by "delete_volume" :: held 1.865s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:21 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" returned: 0 in 0.451s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.937s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:35:21Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-772350042',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1a2594-8218-4bdd-906a-70a9afab74f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bc59e47358b47adb56f31cd300a35b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:35:21Z,use_quota=True,user_id='a66381aeaa64480a9c563d0ba5c3f7d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Creating volume 7a1a2594-8218-4bdd-906a-70a9afab74f1 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:21 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bd67f79-53ea-499f-b0a0-70604ddf721c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684a81ec-313d-418a-b863-ae6dc71f6a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:21 devstack sudo[91030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 1073741824
Apr 21 02:35:21 devstack sudo[91030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:21 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Volume volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b (1d31aff2-dbfc-4a95-bccb-b7653eccd17b): created successfully
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (684a81ec-313d-418a-b863-ae6dc71f6a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:21 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Flow 'volume_create_manager' (a15c2676-f1b3-4e0a-baa3-bddc04dc15c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:21 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-6891e484-81d4-48c6-affb-2c203c7d45db tempest-SnapshotDependencyTests-475494118 None] Created volume successfully.
Apr 21 02:35:22 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.447s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:22 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Deleted volume successfully.
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-10d52b4b-34c6-46a0-8879-9f7e9f5ef321 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-ee78dee4-3adb-46e3-946f-5c47496a1ac2-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Flow 'volume_create_manager' (0d713e25-bae6-45e3-8e37-489d69f44c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bfedff-9dd5-472c-b295-49013a57a6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46bfedff-9dd5-472c-b295-49013a57a6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-361153568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261757f5-9c47-4745-bd23-18d42cf4e9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798f1e49d824dbd9cf430d457c70743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:35:22Z,use_quota=True,user_id='74b3bb8323ee4dae9e42c8d8c36b8e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60123c5-c89d-4100-98ae-82e7620b8c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e60123c5-c89d-4100-98ae-82e7620b8c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c04621-1898-42bb-8df1-bd0ffa4692eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17c04621-1898-42bb-8df1-bd0ffa4692eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '261757f5-9c47-4745-bd23-18d42cf4e9e3', 'volume_name': 'volume-261757f5-9c47-4745-bd23-18d42cf4e9e3', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab9107c-672f-4f09-9572-c6a891ef8435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bab9107c-672f-4f09-9572-c6a891ef8435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02cc8023-4c95-49e4-9221-1d261754af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:22 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Volume 261757f5-9c47-4745-bd23-18d42cf4e9e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-261757f5-9c47-4745-bd23-18d42cf4e9e3', 'volume_size': 1}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:22 devstack sudo[91030]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 1073741824" returned: 0 in 0.514s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:22 devstack sudo[91035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1
Apr 21 02:35:22 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-f990bb5b-c061-459f-b5d6-561e58067a46-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-f990bb5b-c061-459f-b5d6-561e58067a46-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-quobyte-cf2818fc-50f2-4563-a48a-93416e8ede4b" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-cf2818fc-50f2-4563-a48a-93416e8ede4b" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-quobyte-f990bb5b-c061-459f-b5d6-561e58067a46" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-f990bb5b-c061-459f-b5d6-561e58067a46" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Deleting offline snapshot f990bb5b-c061-459f-b5d6-561e58067a46 of volume cf2818fc-50f2-4563-a48a-93416e8ede4b {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] snapshot_file for this snap is: volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5948d8f-e008-40ad-b3bb-60c7302d6f9e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:22 devstack sudo[91037]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46
Apr 21 02:35:22 devstack sudo[91037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:22 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1" returned: 0 in 0.428s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.474s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f3bd2ceb460>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:35:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-361153568',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=261757f5-9c47-4745-bd23-18d42cf4e9e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798f1e49d824dbd9cf430d457c70743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:35:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:35:22Z,use_quota=True,user_id='74b3bb8323ee4dae9e42c8d8c36b8e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)}" {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Creating volume 261757f5-9c47-4745-bd23-18d42cf4e9e3 {{(pid=82686) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:22 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] casted to osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 1073741824 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee838013-cd1a-4add-a172-6f6336fd1932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1a2594-8218-4bdd-906a-70a9afab74f1', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fa79ff-b817-462e-b154-3057cec417f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:22 devstack sudo[91040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 1073741824
Apr 21 02:35:22 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:22 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Volume volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 (7a1a2594-8218-4bdd-906a-70a9afab74f1): created successfully
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9fa79ff-b817-462e-b154-3057cec417f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:22 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Flow 'volume_create_manager' (9ec06826-701a-4ca3-9a33-4ca1e00dad1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:22 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-274de651-f47c-4271-a4eb-55149cc3e20f tempest-CinderUnicodeTest-351844940 None] Created volume successfully.
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:23 devstack sudo[91037]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46" returned: 0 in 0.520s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf2818fc-50f2-4563-a48a-93416e8ede4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[57afd350-4c4e-4789-81a0-c78820ee32a6]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:23 devstack sudo[91045]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b
Apr 21 02:35:23 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:23 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 1073741824" returned: 0 in 0.551s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:23 devstack sudo[91050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3
Apr 21 02:35:23 devstack sudo[91050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:23 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b" returned: 0 in 0.491s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:23 devstack sudo[91055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46
Apr 21 02:35:23 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:23 devstack sudo[91050]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3" returned: 0 in 0.403s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'} {{(pid=82686) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.841s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02cc8023-4c95-49e4-9221-1d261754af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-261757f5-9c47-4745-bd23-18d42cf4e9e3', 'volume_size': 1}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a84ae39-5f4f-4cb6-a5a4-13baa815eed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] Creating offline snapshot bf9c949d-971d-4e16-8ac9-33239f736e90 of volume 1d31aff2-dbfc-4a95-bccb-b7653eccd17b {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:35:23 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Volume volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 (261757f5-9c47-4745-bd23-18d42cf4e9e3): created successfully
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a84ae39-5f4f-4cb6-a5a4-13baa815eed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Flow 'volume_create_manager' (0d713e25-bae6-45e3-8e37-489d69f44c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9173463b-9dc5-4fe9-b1b4-c48f86c1944b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:23 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:23 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-38c35878-975a-468a-84e9-9ba10256fbf3 tempest-VolumeDependencyTests-500811021 None] Created volume successfully.
Apr 21 02:35:24 devstack sudo[91058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b
Apr 21 02:35:24 devstack sudo[91058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:24 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46" returned: 0 in 0.495s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:24 devstack sudo[91063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46
Apr 21 02:35:24 devstack sudo[91063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:24 devstack sudo[91058]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" returned: 0 in 0.515s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:24 devstack sudo[91068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90 1G
Apr 21 02:35:24 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:24 devstack sudo[91063]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b.f990bb5b-c061-459f-b5d6-561e58067a46" returned: 0 in 0.432s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-f990bb5b-c061-459f-b5d6-561e58067a46" released by "_delete_snapshot" :: held 2.003s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-cf2818fc-50f2-4563-a48a-93416e8ede4b" released by "delete_snapshot" :: held 2.014s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created reservations ['5f5733bb-dc36-4496-a306-7c812098efbb', 'be63cd39-a06c-43a2-b14c-a4499d422b8b', '55d24dc6-a89a-49ac-9521-a7c4ce855787', '94e2a1f4-3c6b-4765-9aaf-d492a25b482b'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Flow 'volume_create_manager' (afd99296-b03c-4170-935f-5a11eb169391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713269dc-fcfc-48fb-9966-1469f3798a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713269dc-fcfc-48fb-9966-1469f3798a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1707395002',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fbb9f18-10f9-4a1a-a1f7-16055c677edb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1798f1e49d824dbd9cf430d457c70743',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=261757f5-9c47-4745-bd23-18d42cf4e9e3,status='creating',terminated_at=None,updated_at=2026-04-21T00:35:25Z,use_quota=True,user_id='74b3bb8323ee4dae9e42c8d8c36b8e33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240839df-b59b-459a-a5f4-5633e23a4aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (240839df-b59b-459a-a5f4-5633e23a4aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13884816-a1fd-4f68-a1cb-bfa421659e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13884816-a1fd-4f68-a1cb-bfa421659e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2fbb9f18-10f9-4a1a-a1f7-16055c677edb', 'volume_name': 'volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb', 'volume_size': 1, 'source_volid': '261757f5-9c47-4745-bd23-18d42cf4e9e3', 'source_volstatus': 'available'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4075dc-5fa3-435c-9915-b0afa3e995b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4075dc-5fa3-435c-9915-b0afa3e995b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25053c6f-b4a8-41df-81d4-f6b8dba8b1d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:24 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Volume 2fbb9f18-10f9-4a1a-a1f7-16055c677edb: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb', 'volume_size': 1, 'source_volid': '261757f5-9c47-4745-bd23-18d42cf4e9e3', 'source_volstatus': 'available'}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:24 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Delete snapshot completed successfully.
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-16c57efc-896a-47f8-ba17-e52d0d4e2578 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-f990bb5b-c061-459f-b5d6-561e58067a46-delete_snapshot" released by "delete_snapshot" :: held 2.197s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:24 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90 1G" returned: 0 in 0.518s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:24 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:24 devstack sudo[91074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90
Apr 21 02:35:24 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:25 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90" returned: 0 in 0.432s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:25 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90 is being set with open permissions: ugo+rw
Apr 21 02:35:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:25 devstack sudo[91079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90
Apr 21 02:35:25 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-cf2818fc-50f2-4563-a48a-93416e8ede4b-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-cf2818fc-50f2-4563-a48a-93416e8ede4b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "cinder-quobyte-cf2818fc-50f2-4563-a48a-93416e8ede4b" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:25 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-cf2818fc-50f2-4563-a48a-93416e8ede4b" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:25 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3c1bfa-088c-4ce3-b861-d4152dc222c0]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:25 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90" returned: 0 in 0.464s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:25 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:25 devstack sudo[91082]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b
Apr 21 02:35:25 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:25 devstack sudo[91083]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.info
Apr 21 02:35:25 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:26 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b" returned: 0 in 0.470s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:26 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.info" returned: 0 in 0.426s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:26 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.info is being set with open permissions: ugo+rw
Apr 21 02:35:26 devstack sudo[91090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b
Apr 21 02:35:26 devstack sudo[91090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:26 devstack sudo[91092]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.info
Apr 21 02:35:26 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:26 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:26 devstack sudo[91090]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.info" returned: 0 in 0.389s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.835s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.557s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-cf2818fc-50f2-4563-a48a-93416e8ede4b" returned: 0 in 0.441s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] Creating offline snapshot 84c9d8fc-185c-49ca-8665-54a3a8e5d1bb of volume 7a1a2594-8218-4bdd-906a-70a9afab74f1 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-quobyte-cf2818fc-50f2-4563-a48a-93416e8ede4b" released by "delete_volume" :: held 0.948s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[f458e9ce-28bf-4e62-b987-5b89decf4cb1]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:26 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-1cf3b259-1c63-4a48-baa4-5c9d56f3ceea tempest-SnapshotDependencyTests-475494118 None] Create snapshot completed successfully
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Created reservations ['91f6c8a3-7c4b-46bc-955a-30ff45303fe4', '0c9439d3-77cf-4311-ab92-ec836b99c62f', 'd4dc9880-5278-4fe9-8868-efb8651fe3d3', 'e9007908-c7a5-4f76-878b-d213bd10d1aa'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:26 devstack sudo[91096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1
Apr 21 02:35:26 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:26 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:26 devstack sudo[91098]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:26 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:27 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1" returned: 0 in 0.547s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:27 devstack sudo[91104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb 1G
Apr 21 02:35:27 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:27 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.528s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:27 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Deleted volume successfully.
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-4d555c6a-901e-4f27-9083-b5b313bcc8c0 tempest-CreateVolumesFromSnapshotTest-1187722849 None] Lock "cinder-cf2818fc-50f2-4563-a48a-93416e8ede4b-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.volume.flows.manager.create_volume [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82686) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Flow 'volume_create_manager' (0a39bd93-b6ce-4534-a2b1-9e513f3b5ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0479d7a7-a3ad-4d1e-8252-0db98dfd4552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0479d7a7-a3ad-4d1e-8252-0db98dfd4552) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-04-21T00:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e84b55d-95b3-4121-9d1f-5e8431ee2553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b1cbeb190394128b671690973b27de7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-21T00:35:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf9c949d-971d-4e16-8ac9-33239f736e90,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-21T00:35:27Z,use_quota=True,user_id='885c096ed5f541809d7b1f84af98e26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3),volume_type_id=c9eeaf45-6968-4c4c-b1a6-31e4d77b51f3)' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c7fc01-2e21-4c8b-b71d-19b0a30b4948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6c7fc01-2e21-4c8b-b71d-19b0a30b4948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f530db-4127-49f6-99f2-cf8c0115fe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f530db-4127-49f6-99f2-cf8c0115fe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2e84b55d-95b3-4121-9d1f-5e8431ee2553', 'volume_name': 'volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553', 'volume_size': 1, 'snapshot_id': 'bf9c949d-971d-4e16-8ac9-33239f736e90'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28d653f-bf8c-48d8-b986-83f161b6099a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e28d653f-bf8c-48d8-b986-83f161b6099a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e1fd02-a237-472d-b4f4-a4c6de313613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:27 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Volume 2e84b55d-95b3-4121-9d1f-5e8431ee2553: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553', 'volume_size': 1, 'snapshot_id': 'bf9c949d-971d-4e16-8ac9-33239f736e90'}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:27 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb 1G" returned: 0 in 0.563s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:27 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:27 devstack sudo[91109]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb
Apr 21 02:35:27 devstack sudo[91109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:28 devstack sudo[91109]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb" returned: 0 in 0.415s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:28 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb is being set with open permissions: ugo+rw
Apr 21 02:35:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:28 devstack sudo[91114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb
Apr 21 02:35:28 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:28 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb" returned: 0 in 0.385s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:28 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:28 devstack sudo[91117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.info
Apr 21 02:35:28 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:29 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.info" returned: 0 in 0.395s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:29 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.info is being set with open permissions: ugo+rw
Apr 21 02:35:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:29 devstack sudo[91120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.info
Apr 21 02:35:29 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:29 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.info" returned: 0 in 0.405s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.772s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.701s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:29 devstack cinder-volume[82686]: INFO cinder.volume.drivers.remotefs [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Cloning volume 261757f5-9c47-4745-bd23-18d42cf4e9e3 to volume 2fbb9f18-10f9-4a1a-a1f7-16055c677edb
Apr 21 02:35:29 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-64e81b63-ac28-4e3a-bd97-fc273727e7e8 tempest-CinderUnicodeTest-351844940 None] Create snapshot completed successfully
Apr 21 02:35:29 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Creating offline snapshot de57c110-ff54-4eaa-9a19-b8e4a0630fe0 of volume 261757f5-9c47-4745-bd23-18d42cf4e9e3 {{(pid=82686) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Apr 21 02:35:29 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6d978e-f1dc-43f2-970b-ad792866683b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:29 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:29 devstack sudo[91123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3
Apr 21 02:35:29 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:30 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3" returned: 0 in 0.463s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0 1G {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:30 devstack sudo[91128]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0 1G
Apr 21 02:35:30 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Acquiring lock "cinder-84c9d8fc-185c-49ca-8665-54a3a8e5d1bb-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-84c9d8fc-185c-49ca-8665-54a3a8e5d1bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Acquiring lock "cinder-quobyte-7a1a2594-8218-4bdd-906a-70a9afab74f1" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-quobyte-7a1a2594-8218-4bdd-906a-70a9afab74f1" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Acquiring lock "cinder-quobyte-84c9d8fc-185c-49ca-8665-54a3a8e5d1bb" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-quobyte-84c9d8fc-185c-49ca-8665-54a3a8e5d1bb" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Deleting offline snapshot 84c9d8fc-185c-49ca-8665-54a3a8e5d1bb of volume 7a1a2594-8218-4bdd-906a-70a9afab74f1 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] snapshot_file for this snap is: volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62da9d8-47b6-4433-ba7b-a1aec1331c9c]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:30 devstack sudo[91133]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb
Apr 21 02:35:30 devstack sudo[91133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:30 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0 1G" returned: 0 in 0.491s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:30 devstack sudo[91135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0
Apr 21 02:35:30 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:30 devstack sudo[91133]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb" returned: 0 in 0.469s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a1a2594-8218-4bdd-906a-70a9afab74f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9e2dca-38e6-4392-8a8b-ca111e498b32]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:30 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 -F qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0" returned: 0 in 0.418s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:30 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0 is being set with open permissions: ugo+rw
Apr 21 02:35:30 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:30 devstack sudo[91144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0
Apr 21 02:35:30 devstack sudo[91144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:30 devstack sudo[91143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1
Apr 21 02:35:30 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:31 devstack sudo[91144]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0" returned: 0 in 0.391s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:31 devstack sudo[91151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.info
Apr 21 02:35:31 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:31 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1" returned: 0 in 0.462s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:31 devstack sudo[91154]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb
Apr 21 02:35:31 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:31 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.info" returned: 0 in 0.427s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:31 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.info is being set with open permissions: ugo+rw
Apr 21 02:35:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.info {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:31 devstack sudo[91160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.info
Apr 21 02:35:31 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:31 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb" returned: 0 in 0.443s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:31 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:31 devstack sudo[91162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb
Apr 21 02:35:31 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:32 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.info" returned: 0 in 0.410s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-quobyte-2fbb9f18-10f9-4a1a-a1f7-16055c677edb" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-2fbb9f18-10f9-4a1a-a1f7-16055c677edb" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] snapshot: de57c110-ff54-4eaa-9a19-b8e4a0630fe0, volume: 2fbb9f18-10f9-4a1a-a1f7-16055c677edb,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[098b7705-7c59-4375-baf8-eb4bb8466306]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:32 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1.84c9d8fc-185c-49ca-8665-54a3a8e5d1bb" returned: 0 in 0.412s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-quobyte-84c9d8fc-185c-49ca-8665-54a3a8e5d1bb" released by "_delete_snapshot" :: held 1.837s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-quobyte-7a1a2594-8218-4bdd-906a-70a9afab74f1" released by "delete_snapshot" :: held 1.852s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:32 devstack sudo[91166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0
Apr 21 02:35:32 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Created reservations ['0c8db05c-6ab6-473e-9f08-2c5462b49bfd', '70b009c6-d002-46d7-b5b9-5961051d831d', '98ca7518-79e2-40e3-9f20-a1587dbf3c23', '90cafb72-4b0b-4d8e-bda2-f5d72a452a38'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:32 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Delete snapshot completed successfully.
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-9e367ffa-d397-4f5e-9395-83827761db97 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-84c9d8fc-185c-49ca-8665-54a3a8e5d1bb-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Acquiring lock "cinder-7a1a2594-8218-4bdd-906a-70a9afab74f1-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-7a1a2594-8218-4bdd-906a-70a9afab74f1-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Acquiring lock "cinder-quobyte-7a1a2594-8218-4bdd-906a-70a9afab74f1" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-quobyte-7a1a2594-8218-4bdd-906a-70a9afab74f1" acquired by "delete_volume" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f66e1fe-d631-47ef-9d16-4e52290444b2]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:32 devstack sudo[91168]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1
Apr 21 02:35:32 devstack sudo[91168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:32 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0" returned: 0 in 0.493s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261757f5-9c47-4745-bd23-18d42cf4e9e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc02a8f-0618-4d2f-a77a-303268966f3d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:32 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:32 devstack sudo[91173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3
Apr 21 02:35:32 devstack sudo[91173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:33 devstack sudo[91168]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1" returned: 0 in 0.460s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:33 devstack sudo[91178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1
Apr 21 02:35:33 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:33 devstack sudo[91173]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3" returned: 0 in 0.467s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:33 devstack sudo[91183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb
Apr 21 02:35:33 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:33 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-7a1a2594-8218-4bdd-906a-70a9afab74f1" returned: 0 in 0.406s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-quobyte-7a1a2594-8218-4bdd-906a-70a9afab74f1" released by "delete_volume" :: held 0.902s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Created reservations ['3a803616-41fa-4c42-801e-806e6f25a60c', '25b21de4-0ca2-40dd-8d1e-56f0ddda94d2', '980baaba-b738-4ed3-89a3-9e2450e1800b', '4998e4a4-8b1b-4419-b514-5f333414647c'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:33 devstack sudo[91188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:33 devstack sudo[91188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Acquiring lock "cinder-3841ab41-5c2d-4dae-80bd-eeb66d19ae48-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-3841ab41-5c2d-4dae-80bd-eeb66d19ae48-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Acquiring lock "cinder-quobyte-3841ab41-5c2d-4dae-80bd-eeb66d19ae48" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-quobyte-3841ab41-5c2d-4dae-80bd-eeb66d19ae48" acquired by "delete_volume" :: waited 0.054s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[a663d29f-2b72-4855-bf8e-28ad89fea731]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:33 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:34 devstack sudo[91198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48
Apr 21 02:35:34 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:34 devstack sudo[91188]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:34 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 1.054s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:34 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:34 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Deleted volume successfully.
Apr 21 02:35:34 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-505a53f7-b03f-4a48-88a3-789233fabec5 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-7a1a2594-8218-4bdd-906a-70a9afab74f1-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:35 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:35 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48" returned: 0 in 1.398s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb" returned: 0 in 2.130s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9005d5a6-df1b-4974-870a-996d749b995b]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:35 devstack sudo[91204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48
Apr 21 02:35:35 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:35 devstack sudo[91205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3
Apr 21 02:35:35 devstack sudo[91205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:35 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-3841ab41-5c2d-4dae-80bd-eeb66d19ae48" returned: 0 in 0.403s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-quobyte-3841ab41-5c2d-4dae-80bd-eeb66d19ae48" released by "delete_volume" :: held 1.854s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Created reservations ['4febe71a-210c-46db-a770-502f4718c742', '0b39d5b0-c90d-42ad-affe-c67c55f6b1c1', 'a16785cf-e4cb-4fd4-89a3-1b32e712c052', '38c61ac7-5bfa-4bfa-93cf-d09ec20826d2'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:35 devstack sudo[91211]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:35 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:35 devstack sudo[91205]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3" returned: 0 in 0.575s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3, size 1024.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:35:35 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Converted 1024.00 MB image at 480.40 MB/s
Apr 21 02:35:35 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb is being set with open permissions: ugo+rw
Apr 21 02:35:35 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:35 devstack sudo[91214]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb
Apr 21 02:35:35 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:36 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.452s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:36 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Deleted volume successfully.
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-effb3c7e-b686-4f76-b16d-65f19f163813 tempest-CinderUnicodeTest-351844940 None] Lock "cinder-3841ab41-5c2d-4dae-80bd-eeb66d19ae48-delete_volume" released by "delete_volume" :: held 2.553s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:36 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb" returned: 0 in 0.453s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-2fbb9f18-10f9-4a1a-a1f7-16055c677edb" released by "_copy_volume_from_snapshot" :: held 4.157s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-quobyte-de57c110-ff54-4eaa-9a19-b8e4a0630fe0" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-de57c110-ff54-4eaa-9a19-b8e4a0630fe0" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Deleting offline snapshot de57c110-ff54-4eaa-9a19-b8e4a0630fe0 of volume 261757f5-9c47-4745-bd23-18d42cf4e9e3 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] snapshot_file for this snap is: volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e79ee94-e900-42e1-b705-a65322568298]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:36 devstack sudo[91218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0
Apr 21 02:35:36 devstack sudo[91218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:36 devstack sudo[91218]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0" returned: 0 in 0.527s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-261757f5-9c47-4745-bd23-18d42cf4e9e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9447ad40-2253-421d-9fcd-ac7ac1b2f891]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:36 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:36 devstack sudo[91223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3
Apr 21 02:35:36 devstack sudo[91223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:37 devstack sudo[91223]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3" returned: 0 in 0.496s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:37 devstack sudo[91228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0
Apr 21 02:35:37 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:37 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0" returned: 0 in 0.432s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:37 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:37 devstack sudo[91233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0
Apr 21 02:35:37 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:38 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3.de57c110-ff54-4eaa-9a19-b8e4a0630fe0" returned: 0 in 0.398s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-de57c110-ff54-4eaa-9a19-b8e4a0630fe0" released by "_delete_snapshot" :: held 1.899s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.776s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.678s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "cinder-quobyte-bf9c949d-971d-4e16-8ac9-33239f736e90-2e84b55d-95b3-4121-9d1f-5e8431ee2553" by "_create_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25053c6f-b4a8-41df-81d4-f6b8dba8b1d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb', 'volume_size': 1, 'source_volid': '261757f5-9c47-4745-bd23-18d42cf4e9e3', 'source_volstatus': 'available'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf9ea9f-e0e0-4b60-84d9-2dfb5bb66f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-bf9c949d-971d-4e16-8ac9-33239f736e90-2e84b55d-95b3-4121-9d1f-5e8431ee2553" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Creating volume 2e84b55d-95b3-4121-9d1f-5e8431ee2553 from snapshot bf9c949d-971d-4e16-8ac9-33239f736e90 {{(pid=82686) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Selected osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049 as target Quobyte volume. {{(pid=82686) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "cinder-quobyte-2e84b55d-95b3-4121-9d1f-5e8431ee2553" by "_copy_volume_from_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:38 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Volume volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb (2fbb9f18-10f9-4a1a-a1f7-16055c677edb): created successfully
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf9ea9f-e0e0-4b60-84d9-2dfb5bb66f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Flow 'volume_create_manager' (afd99296-b03c-4170-935f-5a11eb169391) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-2e84b55d-95b3-4121-9d1f-5e8431ee2553" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] snapshot: bf9c949d-971d-4e16-8ac9-33239f736e90, volume: 2e84b55d-95b3-4121-9d1f-5e8431ee2553,  {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.002s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:38 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-af9bead6-c5e5-42a1-869d-35b76401a981 tempest-VolumeDependencyTests-500811021 None] Created volume successfully.
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7edc851-9828-4bc2-9955-77a02385af32]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:38 devstack sudo[91236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90
Apr 21 02:35:38 devstack sudo[91236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-261757f5-9c47-4745-bd23-18d42cf4e9e3-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-261757f5-9c47-4745-bd23-18d42cf4e9e3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-quobyte-261757f5-9c47-4745-bd23-18d42cf4e9e3" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-261757f5-9c47-4745-bd23-18d42cf4e9e3" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[9703ea32-ef69-4856-a7d5-9cdea7f128de]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:38 devstack sudo[91238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3
Apr 21 02:35:38 devstack sudo[91238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:38 devstack sudo[91236]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90" returned: 0 in 0.491s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] will copy from snapshot at /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Creating direct copy from snapshot {{(pid=82686) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[031789c7-5e76-488b-b6b3-d47306f40e47]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:38 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:38 devstack sudo[91243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b
Apr 21 02:35:38 devstack sudo[91243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:39 devstack sudo[91238]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3" returned: 0 in 0.477s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:39 devstack sudo[91248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3
Apr 21 02:35:39 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:39 devstack sudo[91243]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" returned: 0 in 0.511s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG cinder.utils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Path /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553 not found in is_blk_device check {{(pid=82686) is_blk_device /opt/stack/cinder/cinder/utils.py:602}}
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:39 devstack sudo[91254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553
Apr 21 02:35:39 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:39 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-261757f5-9c47-4745-bd23-18d42cf4e9e3" returned: 0 in 0.463s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-261757f5-9c47-4745-bd23-18d42cf4e9e3" released by "delete_volume" :: held 0.982s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Created reservations ['915a48af-77fb-47d3-8334-353a79fb609a', 'bc3d51e5-a8fb-4114-858f-bb651de20f78', '6b66be2a-c2d3-4f44-84e0-79d0523c2297', '44950d26-c2dd-419e-aaa4-c2a7aee8b374'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:39 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:39 devstack sudo[91257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:39 devstack sudo[91257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:40 devstack sudo[91257]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.847s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:40 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:40 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Deleted volume successfully.
Apr 21 02:35:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-b05c433d-f06b-4143-b521-a77b18e83020 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-261757f5-9c47-4745-bd23-18d42cf4e9e3-delete_volume" released by "delete_volume" :: held 1.989s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-2fbb9f18-10f9-4a1a-a1f7-16055c677edb-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Lock "cinder-2fbb9f18-10f9-4a1a-a1f7-16055c677edb-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-quobyte-2fbb9f18-10f9-4a1a-a1f7-16055c677edb" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:40 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-2fbb9f18-10f9-4a1a-a1f7-16055c677edb" acquired by "delete_volume" :: waited 0.020s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:40 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0403ab-67fc-4ba1-bb35-d486ae12669d]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:40 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:40 devstack sudo[91270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb
Apr 21 02:35:40 devstack sudo[91270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:41 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553" returned: 0 in 2.179s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:41 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[287e2c77-8487-4f38-942a-4955af0a0edf]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:41 devstack sudo[91270]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb" returned: 0 in 0.732s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:41 devstack sudo[91277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb
Apr 21 02:35:41 devstack sudo[91277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:41 devstack sudo[91276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b
Apr 21 02:35:41 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:41 devstack sudo[91277]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:41 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2fbb9f18-10f9-4a1a-a1f7-16055c677edb" returned: 0 in 0.409s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:41 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-2fbb9f18-10f9-4a1a-a1f7-16055c677edb" released by "delete_volume" :: held 1.176s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Created reservations ['1c4eeca1-e141-4da9-9237-3f422743a767', 'e35a068f-0e56-4a17-b33d-cee8efb6ef68', '79bfc0e2-3c31-4bdb-897f-992ec5da5f97', '5abdbc07-940f-4235-a7da-e4a551ca8844'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:42 devstack sudo[91283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:42 devstack sudo[91283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:42 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" returned: 0 in 0.605s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.image.image_utils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Image conversion details: src /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b, size 1024.00 MB, duration 2.18 sec, destination /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553 {{(pid=82686) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}}
Apr 21 02:35:42 devstack cinder-volume[82686]: INFO cinder.image.image_utils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Converted 1024.00 MB image at 469.47 MB/s
Apr 21 02:35:42 devstack cinder-volume[82686]: WARNING cinder.volume.drivers.remotefs [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553 is being set with open permissions: ugo+rw
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:42 devstack sudo[91286]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553
Apr 21 02:35:42 devstack sudo[91286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:42 devstack sudo[91283]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.416s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:42 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Deleted volume successfully.
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-aef31a22-df00-4347-b207-6386ff5ca46a tempest-VolumeDependencyTests-500811021 None] Lock "cinder-2fbb9f18-10f9-4a1a-a1f7-16055c677edb-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:42 devstack sudo[91286]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553" returned: 0 in 0.427s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-2e84b55d-95b3-4121-9d1f-5e8431ee2553" released by "_copy_volume_from_snapshot" :: held 4.269s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-bf9c949d-971d-4e16-8ac9-33239f736e90-2e84b55d-95b3-4121-9d1f-5e8431ee2553" released by "_create_volume_from_snapshot" :: held 4.293s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.310s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e1fd02-a237-472d-b4f4-a4c6de313613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553', 'volume_size': 1, 'snapshot_id': 'bf9c949d-971d-4e16-8ac9-33239f736e90'}' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8effea29-7afa-48f1-a5ef-82c92a6f2525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Apr 21 02:35:42 devstack cinder-volume[82686]: INFO cinder.volume.flows.manager.create_volume [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Volume volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553 (2e84b55d-95b3-4121-9d1f-5e8431ee2553): created successfully
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8effea29-7afa-48f1-a5ef-82c92a6f2525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82686) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Flow 'volume_create_manager' (0a39bd93-b6ce-4534-a2b1-9e513f3b5ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82686) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Apr 21 02:35:42 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-81070c49-f51d-4442-b307-f82f19754225 tempest-SnapshotDependencyTests-475494118 None] Created volume successfully.
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-465a9a28-97aa-40ad-893b-46dca1cb23f3-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:42 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-465a9a28-97aa-40ad-893b-46dca1cb23f3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "cinder-quobyte-465a9a28-97aa-40ad-893b-46dca1cb23f3" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-465a9a28-97aa-40ad-893b-46dca1cb23f3" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b978a06-8183-4bbe-9934-ac1bc4e8f8e4]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:43 devstack sudo[91290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3
Apr 21 02:35:43 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "cinder-bf9c949d-971d-4e16-8ac9-33239f736e90-delete_snapshot" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:43 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3" returned: 0 in 0.498s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-bf9c949d-971d-4e16-8ac9-33239f736e90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "cinder-quobyte-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" by "delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:43 devstack sudo[91295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3
Apr 21 02:35:43 devstack sudo[91295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "cinder-quobyte-bf9c949d-971d-4e16-8ac9-33239f736e90" by "_delete_snapshot" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-bf9c949d-971d-4e16-8ac9-33239f736e90" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Deleting offline snapshot bf9c949d-971d-4e16-8ac9-33239f736e90 of volume 1d31aff2-dbfc-4a95-bccb-b7653eccd17b {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] snapshot_file for this snap is: volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90 {{(pid=82686) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[442a44af-3edb-475c-a726-c588edd5d865]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:43 devstack sudo[91297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90
Apr 21 02:35:43 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:43 devstack sudo[91295]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-465a9a28-97aa-40ad-893b-46dca1cb23f3" returned: 0 in 0.411s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-quobyte-465a9a28-97aa-40ad-893b-46dca1cb23f3" released by "delete_volume" :: held 0.928s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:43 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Created reservations ['c9441aa1-d19e-488b-800e-d0a81f4439dd', '8d6395ee-c37b-44e0-9673-d8ac77fa8fb4', 'da6a4adf-fa23-4fea-b48d-eb60d06bffea', '1eb01abf-1189-4abd-8d5d-3fb29f4c0830'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:44 devstack sudo[91303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:44 devstack sudo[91303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:44 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90" returned: 0 in 0.482s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.remotefs [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82686) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d51890-6d94-4385-8b8f-9591d7b61c7e]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:44 devstack sudo[91305]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b
Apr 21 02:35:44 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:44 devstack sudo[91303]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.453s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:44 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Deleted volume successfully.
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-297f01b8-31eb-41b0-9d3c-527a6885f501 tempest-VolumeDependencyTests-500811021 None] Lock "cinder-465a9a28-97aa-40ad-893b-46dca1cb23f3-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:44 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" returned: 0 in 0.527s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:44 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:44 devstack sudo[91311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90
Apr 21 02:35:44 devstack sudo[91311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:45 devstack sudo[91311]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90" returned: 0 in 0.483s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:45 devstack sudo[91316]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90
Apr 21 02:35:45 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:45 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b.bf9c949d-971d-4e16-8ac9-33239f736e90" returned: 0 in 0.409s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=194,cinder:UPDATE=308,cinder:DELETE=32,cinder:INSERT=63 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=208,cinder:UPDATE=255,cinder:INSERT=70,cinder:DELETE=20 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-bf9c949d-971d-4e16-8ac9-33239f736e90" released by "_delete_snapshot" :: held 1.962s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" released by "delete_snapshot" :: held 1.972s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Created reservations ['e0c98cb5-9aa2-4d24-b6a3-68b1e3fbc69f', '66f86426-10a4-4290-bd73-3e76b9062115', '03efede3-1b93-4c8c-b09f-219ecdc62b92', '8125b33b-4326-4dbc-9f23-d3eb42a8de8a'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:45 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Delete snapshot completed successfully.
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-53b4146b-b8d5-4481-8df4-334b07b086a9 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-bf9c949d-971d-4e16-8ac9-33239f736e90-delete_snapshot" released by "delete_snapshot" :: held 2.056s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "cinder-1d31aff2-dbfc-4a95-bccb-b7653eccd17b-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-1d31aff2-dbfc-4a95-bccb-b7653eccd17b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "cinder-quobyte-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[88adbb58-e4d9-459a-af01-a86a2157de72]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:45 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:45 devstack sudo[91319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b
Apr 21 02:35:45 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:46 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" returned: 0 in 0.464s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:46 devstack sudo[91324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b
Apr 21 02:35:46 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:46 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" returned: 0 in 0.416s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-1d31aff2-dbfc-4a95-bccb-b7653eccd17b" released by "delete_volume" :: held 0.911s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Created reservations ['fc5eb746-d69d-49e3-915e-f515be631b2b', 'da184310-e7e0-4967-a061-2b0f4861d597', 'd8451099-e1f3-4dc5-80d4-eabc00e530f8', '8e3bc4ed-a488-4bbc-ab5e-bbf0707ebcc6'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:46 devstack sudo[91327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:46 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "cinder-2e84b55d-95b3-4121-9d1f-5e8431ee2553-delete_volume" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-2e84b55d-95b3-4121-9d1f-5e8431ee2553-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "cinder-quobyte-2e84b55d-95b3-4121-9d1f-5e8431ee2553" by "delete_volume" {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-2e84b55d-95b3-4121-9d1f-5e8431ee2553" acquired by "delete_volume" :: waited 0.007s {{(pid=82686) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG oslo.privsep.daemon [-] privsep: reply[e597ae23-1317-4f7b-a46d-c6fa4a8ffe90]: (4, 'qcow2') {{(pid=83822) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}}
Apr 21 02:35:46 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:46 devstack sudo[91329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553
Apr 21 02:35:46 devstack sudo[91329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:47 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.419s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:47 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Deleted volume successfully.
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-bf3f5a90-189a-4520-b34f-444f651cf548 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-1d31aff2-dbfc-4a95-bccb-b7653eccd17b-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:47 devstack sudo[91329]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553" returned: 0 in 0.476s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:47 devstack sudo[91335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553
Apr 21 02:35:47 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:47 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9/volume-2e84b55d-95b3-4121-9d1f-5e8431ee2553" returned: 0 in 0.408s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-quobyte-2e84b55d-95b3-4121-9d1f-5e8431ee2553" released by "delete_volume" :: held 0.904s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG cinder.quota [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Created reservations ['cb33e113-e2ad-44c6-a466-840e38e630df', '69383d1a-d7ee-4266-933c-ca43c944a212', '486738d3-e257-4ca1-a9bb-23529736fa94', '8f247094-00c6-4dba-8516-4c263f8c7fe0'] {{(pid=82686) reserve /opt/stack/cinder/cinder/quota.py:752}}
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:35:47 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:35:47 devstack sudo[91338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:35:47 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:35:48 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root
Apr 21 02:35:48 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.425s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:35:48 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Apr 21 02:35:48 devstack cinder-volume[82686]: INFO cinder.volume.manager [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Deleted volume successfully.
Apr 21 02:35:48 devstack cinder-volume[82686]: DEBUG cinder.coordination [None req-c9be35bf-8148-43e1-ad6f-1691d21b6c74 tempest-SnapshotDependencyTests-475494118 None] Lock "cinder-2e84b55d-95b3-4121-9d1f-5e8431ee2553-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=82686) __release /opt/stack/cinder/cinder/coordination.py:152}}
Apr 21 02:35:57 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=14,cinder:INSERT=7,cinder:UPDATE=17,cinder:DELETE=1 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:35:58 devstack cinder-volume[82686]: DEBUG dbcounter [-] [82686] Writing DB stats cinder:SELECT=15,cinder:INSERT=5,cinder:UPDATE=26,cinder:DELETE=1 {{(pid=82686) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Apr 21 02:36:02 devstack cinder-volume[82686]: DEBUG oslo_service.periodic_task [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82686) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Apr 21 02:36:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}}
Apr 21 02:36:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}}
Apr 21 02:36:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049': None} {{(pid=82686) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}}
Apr 21 02:36:02 devstack cinder-volume[82686]: DEBUG cinder.volume.drivers.quobyte [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-28576538-758a-4c4f-b65c-e22fffef5049'] {{(pid=82686) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}}
Apr 21 02:36:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.lockutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82686) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}}
Apr 21 02:36:02 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9 {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}}
Apr 21 02:36:02 devstack sudo[91490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9
Apr 21 02:36:02 devstack sudo[91490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Apr 21 02:36:03 devstack sudo[91490]: pam_unix(sudo:session): session closed for user root
Apr 21 02:36:03 devstack cinder-volume[82686]: DEBUG oslo_concurrency.processutils [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/01b725a84c06cbf974664bc6dadcc8c9" returned: 0 in 0.420s {{(pid=82686) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}}
Apr 21 02:36:03 devstack cinder-volume[82686]: DEBUG cinder.manager [None req-3faffe64-0fbd-4479-8296-8ae67d82fafc None None] Notifying Schedulers of capabilities ... {{(pid=82686) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}